2024-04-15T14:37:58.792 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T14:37:58.792 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826 --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} --verbose --name teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826/orig.config.yaml 2024-04-15T14:37:58.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T14:37:58.925 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826 branch: main description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7655826' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd heartbeat grace: 80 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 120 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request mon_bind_msgr2: false sha1: c2d8c3155d854ee204cb7c7261232571229d1d54 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: debuginfo: true flavor: default sha1: c2d8c3155d854ee204cb7c7261232571229d1d54 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 owner: scheduled_teuthology@teuthology priority: 951 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 5211 sha1: c2d8c3155d854ee204cb7c7261232571229d1d54 sleep_before_teardown: 0 subset: 28113/100000 suite: rados suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 87dbfb632e974cb2c28d17423071d2d833b53b29 targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOLjzXDOzgXZQzVqhxbG5Oakkk3pLU1R4C0TuVLccquskFlqweIMfmsWvL47IjkpEc1eUIoV8iPCP89JL9dNZr8= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOA2DT3B/BUm0x9GQsawbta3I49Xp2q/1coiuBPx+TZRq/IS+v/NygeXz5+t3MTUkiiiHuDSg4orcWGbJoygu1M= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-14_20:00:15 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-15T14:37:58.926 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa; will attempt to use it 2024-04-15T14:37:58.926 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks 2024-04-15T14:37:58.927 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-15T14:37:58.928 INFO:teuthology.task.internal:Checking packages... 2024-04-15T14:37:58.953 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c2d8c3155d854ee204cb7c7261232571229d1d54' 2024-04-15T14:37:58.953 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-15T14:37:58.954 INFO:teuthology.packaging:ref: None 2024-04-15T14:37:58.954 INFO:teuthology.packaging:tag: None 2024-04-15T14:37:58.954 INFO:teuthology.packaging:branch: main 2024-04-15T14:37:58.954 INFO:teuthology.packaging:sha1: c2d8c3155d854ee204cb7c7261232571229d1d54 2024-04-15T14:37:58.954 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-04-15T14:37:59.186 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3084.g87dbfb63 2024-04-15T14:37:59.188 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-15T14:37:59.196 INFO:teuthology.task.internal:no buildpackages task found 2024-04-15T14:37:59.196 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-15T14:37:59.205 INFO:teuthology.task.internal:Saving configuration 2024-04-15T14:37:59.222 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-15T14:37:59.230 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T14:37:59.256 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 14:32:41.700411', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOLjzXDOzgXZQzVqhxbG5Oakkk3pLU1R4C0TuVLccquskFlqweIMfmsWvL47IjkpEc1eUIoV8iPCP89JL9dNZr8='} 2024-04-15T14:37:59.281 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 14:32:41.698435', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOA2DT3B/BUm0x9GQsawbta3I49Xp2q/1coiuBPx+TZRq/IS+v/NygeXz5+t3MTUkiiiHuDSg4orcWGbJoygu1M='} 2024-04-15T14:37:59.281 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-15T14:37:59.289 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-15T14:37:59.289 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-15T14:37:59.289 INFO:teuthology.run_tasks:Running task console_log... 2024-04-15T14:37:59.361 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe58d6d5e50>, signals=[15]) 2024-04-15T14:37:59.362 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-15T14:37:59.371 INFO:teuthology.task.internal:Opening connections... 2024-04-15T14:37:59.371 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T14:37:59.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:37:59.479 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T14:37:59.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:37:59.569 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-15T14:37:59.577 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-04-15T14:37:59.596 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-04-15T14:37:59.597 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-04-15T14:37:59.654 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-04-15T14:37:59.654 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-04-15T14:37:59.654 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-04-15T14:37:59.654 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T14:37:59.655 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T14:37:59.656 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-04-15T14:37:59.680 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-04-15T14:37:59.697 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-04-15T14:37:59.697 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-15T14:37:59.755 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-04-15T14:37:59.755 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-04-15T14:37:59.755 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-04-15T14:37:59.755 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-04-15T14:37:59.755 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-04-15T14:37:59.755 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-04-15T14:37:59.755 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T14:37:59.755 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-04-15T14:37:59.755 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-04-15T14:37:59.756 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T14:37:59.756 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-04-15T14:37:59.756 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T14:37:59.756 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T14:37:59.756 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T14:37:59.756 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-15T14:37:59.780 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-15T14:37:59.789 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-15T14:37:59.796 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-15T14:37:59.796 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2024-04-15T14:37:59.799 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-04-15T14:37:59.815 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-15T14:37:59.821 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-15T14:37:59.821 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2024-04-15T14:37:59.856 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-04-15T14:37:59.884 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-15T14:37:59.938 INFO:teuthology.run_tasks:Running task kernel... 2024-04-15T14:37:59.954 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-15T14:37:59.954 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-15T14:37:59.954 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T14:37:59.955 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T14:37:59.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T14:37:59.971 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-15T14:37:59.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T14:37:59.972 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-04-15T14:38:00.028 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-361.el9.x86_64 2024-04-15T14:38:00.028 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.14.0-361.el9.x86_64 2024-04-15T14:38:00.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2024-04-15T14:38:00.030 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-361.el9.x86_64 2024-04-15T14:38:00.030 INFO:teuthology.task.kernel:Running kernel on smithi038: 5.14.0-361.el9.x86_64 2024-04-15T14:38:00.030 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2024-04-15T14:38:02.037 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-04-15T14:38:02.146 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-04-15T14:38:03.429 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - BaseOS 8.2 MB/s | 2.0 MB 00:00 2024-04-15T14:38:03.589 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-04-15T14:38:04.586 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-15T14:38:04.613 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-15T14:38:06.981 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-15T14:38:07.223 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-04-15T14:38:11.313 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-15T14:38:12.897 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-15T14:38:13.665 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.2 MB 00:03 2024-04-15T14:38:14.392 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-15T14:38:15.307 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-04-15T14:38:17.403 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-15T14:38:19.523 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-15T14:38:21.889 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T14:38:21.889 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T14:38:21.976 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:38:21.981 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:38:21.981 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:38:21.981 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:38:21.981 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:38:21.981 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-15T14:38:21.982 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:38:21.982 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-15T14:38:21.982 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-15T14:38:21.982 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-15T14:38:21.982 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:38:21.982 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:38:21.982 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:38:21.982 INFO:teuthology.orchestra.run.smithi164.stdout:Install 4 Packages 2024-04-15T14:38:21.982 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:38:21.983 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 77 M 2024-04-15T14:38:21.983 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 123 M 2024-04-15T14:38:21.983 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:38:22.150 INFO:teuthology.orchestra.run.smithi164.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.6 MB/s | 277 kB 00:00 2024-04-15T14:38:22.575 INFO:teuthology.orchestra.run.smithi164.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 26 MB/s | 15 MB 00:00 2024-04-15T14:38:22.625 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-15T14:38:23.104 INFO:teuthology.orchestra.run.smithi164.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 30 MB/s | 34 MB 00:01 2024-04-15T14:38:23.575 INFO:teuthology.orchestra.run.smithi164.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 19 MB/s | 28 MB 00:01 2024-04-15T14:38:23.578 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:38:23.578 INFO:teuthology.orchestra.run.smithi164.stdout:Total 48 MB/s | 77 MB 00:01 2024-04-15T14:38:23.578 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:38:23.940 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:38:23.940 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:38:24.786 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:38:24.786 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:38:25.116 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T14:38:25.116 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T14:38:25.217 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:38:25.222 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:38:25.222 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:38:25.222 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:38:25.222 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:38:25.222 INFO:teuthology.orchestra.run.smithi038.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-15T14:38:25.222 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:38:25.222 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-15T14:38:25.222 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-15T14:38:25.223 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-15T14:38:25.223 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:38:25.223 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:38:25.223 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:38:25.223 INFO:teuthology.orchestra.run.smithi038.stdout:Install 4 Packages 2024-04-15T14:38:25.223 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:38:25.223 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 77 M 2024-04-15T14:38:25.224 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 123 M 2024-04-15T14:38:25.224 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:38:25.368 INFO:teuthology.orchestra.run.smithi038.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.9 MB/s | 277 kB 00:00 2024-04-15T14:38:25.785 INFO:teuthology.orchestra.run.smithi038.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 27 MB/s | 15 MB 00:00 2024-04-15T14:38:26.535 INFO:teuthology.orchestra.run.smithi038.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 26 MB/s | 34 MB 00:01 2024-04-15T14:38:26.902 INFO:teuthology.orchestra.run.smithi038.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 18 MB/s | 28 MB 00:01 2024-04-15T14:38:26.905 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:38:26.906 INFO:teuthology.orchestra.run.smithi038.stdout:Total 46 MB/s | 77 MB 00:01 2024-04-15T14:38:26.906 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:38:27.088 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:38:27.341 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:38:27.342 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:38:27.691 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-15T14:38:27.775 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T14:38:28.214 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:38:28.215 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:38:30.535 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T14:38:30.642 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:38:30.678 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T14:38:31.274 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-15T14:38:31.363 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T14:38:34.258 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T14:38:34.403 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T14:38:35.422 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T14:38:35.527 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:38:39.468 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T14:38:39.511 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:38:40.263 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:38:44.605 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:39:09.696 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:39:09.696 INFO:teuthology.orchestra.run.smithi164.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T14:39:09.696 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:39:09.740 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:39:10.129 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:39:10.129 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-15T14:39:10.129 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T14:39:10.129 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T14:39:10.521 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:39:10.521 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:39:10.521 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:39:10.521 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-15T14:39:10.521 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-15T14:39:10.521 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-15T14:39:10.521 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-15T14:39:10.522 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:39:10.522 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:39:10.898 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T14:39:10.995 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T14:39:10.995 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T14:39:10.995 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-15T14:39:10.995 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T14:39:10.995 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T14:39:10.996 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-15T14:39:10.996 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T14:39:10.996 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T14:39:11.076 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T14:39:11.076 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T14:39:11.077 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-04-15T14:39:11.124 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 68.el9 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8264254 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T14:39:11.125 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:39:11.126 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T14:39:11.127 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T14:39:11.127 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 5.14.0-438.el9.x86_64 2024-04-15T14:39:11.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T14:39:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-04-15T14:39:13.071 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T14:39:13.107 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-04-15T14:39:13.110 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-04-15T14:39:13.127 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.T1eMqZCEvY 2024-04-15T14:39:13.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.T1eMqZCEvY 2024-04-15T14:39:13.195 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.T1eMqZCEvY 2024-04-15T14:39:13.343 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.T1eMqZCEvY is 6KB 2024-04-15T14:39:13.390 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.T1eMqZCEvY 2024-04-15T14:39:13.404 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T14:39:13.469 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T14:39:13.469 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T14:39:13.469 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T14:39:13.469 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-15T14:39:13.470 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-15T14:39:13.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-04-15T14:39:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:39:15.487 INFO:teuthology.orchestra.run.smithi038.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T14:39:15.487 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:39:15.533 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:39:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:39:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-15T14:39:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T14:39:15.925 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T14:39:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T14:39:16.317 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:39:16.318 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:39:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-15T14:39:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-15T14:39:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-15T14:39:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-15T14:39:16.318 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:39:16.318 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:39:16.648 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T14:39:16.752 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T14:39:16.753 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T14:39:16.753 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-15T14:39:16.753 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T14:39:16.753 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T14:39:16.753 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-15T14:39:16.753 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T14:39:16.753 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T14:39:16.838 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T14:39:16.838 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T14:39:16.838 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2024-04-15T14:39:16.876 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2024-04-15T14:39:16.876 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2024-04-15T14:39:16.876 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.06 2024-04-15T14:39:16.876 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 68.el9 2024-04-15T14:39:16.876 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2024-04-15T14:39:16.876 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T14:39:16.876 INFO:teuthology.orchestra.run.smithi038.stdout:Group : Unspecified 2024-04-15T14:39:16.876 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 8264254 2024-04-15T14:39:16.876 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : builder@centos.org 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T14:39:16.877 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2024-04-15T14:39:16.878 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:39:16.878 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T14:39:16.879 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T14:39:16.879 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 5.14.0-438.el9.x86_64 2024-04-15T14:39:16.879 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T14:39:17.468 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2024-04-15T14:39:18.878 INFO:teuthology.orchestra.run.smithi038.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T14:39:18.913 INFO:teuthology.orchestra.run.smithi038.stderr:done 2024-04-15T14:39:18.915 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-04-15T14:39:18.931 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.fLOT09XUnl 2024-04-15T14:39:18.931 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fLOT09XUnl 2024-04-15T14:39:19.003 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.fLOT09XUnl 2024-04-15T14:39:19.142 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.fLOT09XUnl is 6KB 2024-04-15T14:39:19.192 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.fLOT09XUnl 2024-04-15T14:39:19.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T14:39:19.274 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T14:39:19.274 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T14:39:19.274 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T14:39:19.274 INFO:teuthology.orchestra.run.smithi038.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-15T14:39:19.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-15T14:39:19.437 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2024-04-15T14:39:43.650 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-15T14:39:43.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-15T14:39:43.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:39:49.446 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-15T14:39:49.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-15T14:39:49.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:40:18.207 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-15T14:40:24.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-15T14:40:27.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-15T14:40:27.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:40:33.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-15T14:40:33.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:40:51.487 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-15T14:41:03.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-15T14:41:03.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:41:03.937 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-04-15T14:41:04.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-15T14:41:04.328 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-438.el9.x86_64"... 2024-04-15T14:41:04.328 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-04-15T14:41:04.343 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-438.el9.x86_64 2024-04-15T14:41:04.343 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-15T14:41:04.344 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T14:41:04.344 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T14:41:05.345 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-15T14:41:05.345 DEBUG:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T14:41:05.441 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2024-04-15T14:41:05.477 DEBUG:teuthology.parallel:result is None 2024-04-15T14:41:27.214 DEBUG:teuthology.orchestra.remote:timed out 2024-04-15T14:41:39.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-15T14:41:39.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:41:39.606 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-15T14:41:40.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-15T14:41:40.000 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-438.el9.x86_64"... 2024-04-15T14:41:40.001 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-15T14:41:40.016 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-438.el9.x86_64 2024-04-15T14:41:40.017 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-15T14:41:40.017 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T14:41:40.017 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T14:41:41.018 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-15T14:41:41.018 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T14:41:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-04-15T14:41:41.116 DEBUG:teuthology.parallel:result is None 2024-04-15T14:41:41.116 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-15T14:41:41.126 INFO:teuthology.task.internal:Creating test directory... 2024-04-15T14:41:41.126 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T14:41:41.129 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T14:41:41.148 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-15T14:41:41.158 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-15T14:41:41.165 INFO:teuthology.task.internal:Creating archive directory... 2024-04-15T14:41:41.165 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T14:41:41.188 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T14:41:41.216 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-15T14:41:41.222 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-15T14:41:41.222 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T14:41:41.254 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T14:41:41.295 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T14:41:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T14:41:41.310 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T14:41:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T14:41:41.313 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-15T14:41:41.320 INFO:teuthology.task.internal:Configuring sudo... 2024-04-15T14:41:41.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T14:41:41.355 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T14:41:41.386 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-15T14:41:41.395 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-15T14:41:41.395 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T14:41:41.426 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T14:41:41.442 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T14:41:41.526 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T14:41:41.576 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T14:41:41.658 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T14:41:41.703 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:41:41.703 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T14:41:41.772 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T14:41:41.815 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T14:41:41.869 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T14:41:41.951 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T14:41:41.996 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:41:41.996 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T14:41:42.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2024-04-15T14:41:42.068 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-04-15T14:41:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T14:41:42.154 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T14:41:42.586 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-15T14:41:42.594 INFO:teuthology.task.internal:Starting timer... 2024-04-15T14:41:42.594 INFO:teuthology.run_tasks:Running task pcp... 2024-04-15T14:41:42.606 INFO:teuthology.run_tasks:Running task selinux... 2024-04-15T14:41:42.614 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-15T14:41:42.614 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2024-04-15T14:41:42.669 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2024-04-15T14:41:42.671 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-04-15T14:41:42.726 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-04-15T14:41:42.728 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-15T14:41:42.728 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2024-04-15T14:41:42.753 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2024-04-15T14:41:42.753 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-04-15T14:41:42.804 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-04-15T14:41:42.804 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2024-04-15T14:41:42.804 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T14:41:42.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T14:41:42.834 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T14:41:42.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T14:41:42.862 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-15T14:41:42.865 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2024-04-15T14:41:42.913 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-04-15T14:41:42.947 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-15T14:41:42.956 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-15T14:41:42.961 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-15T14:41:43.112 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-15T14:41:43.127 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-15T14:41:43.129 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-15T14:46:06.096 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-04-15T14:46:06.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-15T14:46:06.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:46:06.192 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-04-15T14:46:06.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-15T14:46:06.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-15T14:46:06.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T14:46:06.360 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-15T14:46:06.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-15T14:46:06.448 INFO:teuthology.run_tasks:Running task clock... 2024-04-15T14:46:06.461 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-15T14:46:06.462 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T14:46:06.462 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T14:46:06.465 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T14:46:06.465 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T14:46:06.496 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T14:46:06.515 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T14:46:06.521 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T14:46:06.539 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T14:46:06.546 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2024-04-15T14:46:06.560 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2024-04-15T14:46:06.570 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-04-15T14:46:06.579 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T14:46:06.584 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-04-15T14:46:06.596 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T14:46:06.602 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T14:46:06.619 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T14:46:06.652 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-04-15T14:46:06.656 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T14:46:06.656 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-04-15T14:46:06.656 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T14:46:06.656 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T14:46:06.656 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T14:46:06.656 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T14:46:06.678 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-15T14:46:06.681 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T14:46:06.681 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-15T14:46:06.682 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T14:46:06.682 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T14:46:06.682 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T14:46:06.682 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T14:46:06.683 INFO:teuthology.run_tasks:Running task install... 2024-04-15T14:46:06.692 DEBUG:teuthology.task.install:project ceph 2024-04-15T14:46:06.692 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'c2d8c3155d854ee204cb7c7261232571229d1d54'}} 2024-04-15T14:46:06.692 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': 'c2d8c3155d854ee204cb7c7261232571229d1d54'} 2024-04-15T14:46:06.692 INFO:teuthology.task.install:Using flavor: default 2024-04-15T14:46:06.698 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-15T14:46:06.698 INFO:teuthology.task.install:extra packages: [] 2024-04-15T14:46:06.699 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2d8c3155d854ee204cb7c7261232571229d1d54', 'tag': None, 'wait_for_package': False} 2024-04-15T14:46:06.699 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2d8c3155d854ee204cb7c7261232571229d1d54 2024-04-15T14:46:06.701 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2d8c3155d854ee204cb7c7261232571229d1d54', 'tag': None, 'wait_for_package': False} 2024-04-15T14:46:06.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2d8c3155d854ee204cb7c7261232571229d1d54 2024-04-15T14:46:06.843 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/c2d8c3155d854ee204cb7c7261232571229d1d54/centos/9/flavors/default/ 2024-04-15T14:46:06.843 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3080.gc2d8c315 2024-04-15T14:46:06.911 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/c2d8c3155d854ee204cb7c7261232571229d1d54/centos/9/flavors/default/ 2024-04-15T14:46:06.912 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3080.gc2d8c315 2024-04-15T14:46:06.983 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/c2d8c3155d854ee204cb7c7261232571229d1d54/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/c2d8c3155d854ee204cb7c7261232571229d1d54/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/c2d8c3155d854ee204cb7c7261232571229d1d54/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T14:46:06.984 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:46:06.984 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T14:46:07.014 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2024-04-15T14:46:07.015 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2d8c3155d854ee204cb7c7261232571229d1d54/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T14:46:07.025 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/c2d8c3155d854ee204cb7c7261232571229d1d54/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/c2d8c3155d854ee204cb7c7261232571229d1d54/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/c2d8c3155d854ee204cb7c7261232571229d1d54/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T14:46:07.025 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:46:07.025 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T14:46:07.055 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2024-04-15T14:46:07.055 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2d8c3155d854ee204cb7c7261232571229d1d54/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T14:46:07.084 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T14:46:07.125 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T14:46:07.165 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T14:46:07.207 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T14:46:07.234 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2024-04-15T14:46:07.236 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2024-04-15T14:46:07.275 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-04-15T14:46:07.277 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-04-15T14:46:07.491 INFO:teuthology.orchestra.run.smithi038.stdout:74 files removed 2024-04-15T14:46:07.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw 2024-04-15T14:46:07.527 INFO:teuthology.orchestra.run.smithi164.stdout:74 files removed 2024-04-15T14:46:07.553 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw 2024-04-15T14:46:08.242 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 202 kB/s | 83 kB 00:00 2024-04-15T14:46:08.272 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 202 kB/s | 83 kB 00:00 2024-04-15T14:46:08.823 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 23 kB/s | 12 kB 00:00 2024-04-15T14:46:08.851 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 21 kB/s | 12 kB 00:00 2024-04-15T14:46:09.268 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-04-15T14:46:09.332 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-04-15T14:46:09.951 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-15T14:46:10.154 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - AppStream 7.9 MB/s | 6.7 MB 00:00 2024-04-15T14:46:11.393 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2024-04-15T14:46:11.638 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2024-04-15T14:46:12.258 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-15T14:46:14.735 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-15T14:46:14.945 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.0 MB 00:02 2024-04-15T14:46:16.846 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-15T14:46:19.344 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.2 MB 00:01 2024-04-15T14:46:20.961 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-04-15T14:46:22.956 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.2 MB 00:02 2024-04-15T14:46:24.496 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 21 MB 00:03 2024-04-15T14:46:24.673 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-15T14:46:27.149 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 21 MB 00:02 2024-04-15T14:46:29.537 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-04-15T14:46:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 11 M 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 3.4 M 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 3.1 M 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 5.4 M 2024-04-15T14:46:32.287 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 21 M 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 25 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 747 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 501 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 5.4 M 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T14:46:32.288 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 45 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 135 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 162 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 320 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 298 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 100 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T14:46:32.289 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T14:46:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-04-15T14:46:32.290 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-15T14:46:32.290 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:46:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:46:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:46:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:Install 30 Packages 2024-04-15T14:46:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 2 Packages 2024-04-15T14:46:32.290 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:46:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 60 M 2024-04-15T14:46:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:46:32.441 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-15T14:46:33.238 INFO:teuthology.orchestra.run.smithi164.stdout:(1/32): ceph-radosgw-19.0.0-3080.gc2d8c315.el9. 13 MB/s | 11 MB 00:00 2024-04-15T14:46:33.271 INFO:teuthology.orchestra.run.smithi164.stdout:(2/32): ceph-selinux-19.0.0-3080.gc2d8c315.el9. 760 kB/s | 25 kB 00:00 2024-04-15T14:46:33.347 INFO:teuthology.orchestra.run.smithi164.stdout:(3/32): libcephfs2-19.0.0-3080.gc2d8c315.el9.x8 9.7 MB/s | 747 kB 00:00 2024-04-15T14:46:33.414 INFO:teuthology.orchestra.run.smithi164.stdout:(4/32): libradosstriper1-19.0.0-3080.gc2d8c315. 7.3 MB/s | 501 kB 00:00 2024-04-15T14:46:33.731 INFO:teuthology.orchestra.run.smithi164.stdout:(5/32): librgw2-19.0.0-3080.gc2d8c315.el9.x86_6 17 MB/s | 5.4 MB 00:00 2024-04-15T14:46:33.773 INFO:teuthology.orchestra.run.smithi164.stdout:(6/32): python3-ceph-argparse-19.0.0-3080.gc2d8 1.1 MB/s | 45 kB 00:00 2024-04-15T14:46:33.823 INFO:teuthology.orchestra.run.smithi164.stdout:(7/32): python3-ceph-common-19.0.0-3080.gc2d8c3 2.6 MB/s | 135 kB 00:00 2024-04-15T14:46:33.890 INFO:teuthology.orchestra.run.smithi164.stdout:(8/32): python3-cephfs-19.0.0-3080.gc2d8c315.el 2.4 MB/s | 162 kB 00:00 2024-04-15T14:46:33.949 INFO:teuthology.orchestra.run.smithi164.stdout:(9/32): python3-rados-19.0.0-3080.gc2d8c315.el9 5.4 MB/s | 320 kB 00:00 2024-04-15T14:46:34.016 INFO:teuthology.orchestra.run.smithi164.stdout:(10/32): ceph-base-19.0.0-3080.gc2d8c315.el9.x8 3.4 MB/s | 5.4 MB 00:01 2024-04-15T14:46:34.041 INFO:teuthology.orchestra.run.smithi164.stdout:(11/32): python3-rbd-19.0.0-3080.gc2d8c315.el9. 3.2 MB/s | 298 kB 00:00 2024-04-15T14:46:34.100 INFO:teuthology.orchestra.run.smithi164.stdout:(12/32): python3-rgw-19.0.0-3080.gc2d8c315.el9. 1.2 MB/s | 100 kB 00:00 2024-04-15T14:46:34.166 INFO:teuthology.orchestra.run.smithi164.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2024-04-15T14:46:34.192 INFO:teuthology.orchestra.run.smithi164.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 703 kB/s | 106 kB 00:00 2024-04-15T14:46:34.217 INFO:teuthology.orchestra.run.smithi164.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2024-04-15T14:46:34.259 INFO:teuthology.orchestra.run.smithi164.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-04-15T14:46:34.284 INFO:teuthology.orchestra.run.smithi164.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-04-15T14:46:34.309 INFO:teuthology.orchestra.run.smithi164.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 824 kB/s | 41 kB 00:00 2024-04-15T14:46:34.335 INFO:teuthology.orchestra.run.smithi164.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-15T14:46:34.360 INFO:teuthology.orchestra.run.smithi164.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 697 kB/s | 35 kB 00:00 2024-04-15T14:46:34.385 INFO:teuthology.orchestra.run.smithi164.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 922 kB/s | 46 kB 00:00 2024-04-15T14:46:34.936 INFO:teuthology.orchestra.run.smithi164.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 537 kB/s | 309 kB 00:00 2024-04-15T14:46:35.036 INFO:teuthology.orchestra.run.smithi164.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-04-15T14:46:35.128 INFO:teuthology.orchestra.run.smithi164.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 531 kB/s | 49 kB 00:00 2024-04-15T14:46:35.289 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:46:35.293 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:46:35.293 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:46:35.293 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:46:35.293 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:46:35.293 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 11 M 2024-04-15T14:46:35.293 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2024-04-15T14:46:35.293 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 3.4 M 2024-04-15T14:46:35.293 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 3.1 M 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 5.4 M 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 21 M 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 25 k 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 747 k 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-15T14:46:35.294 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 501 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 5.4 M 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 45 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 135 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 162 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 320 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 298 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 100 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-15T14:46:35.295 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout:Installing weak dependencies: 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout:Install 30 Packages 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 2 Packages 2024-04-15T14:46:35.296 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:46:35.297 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 60 M 2024-04-15T14:46:35.297 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:46:35.328 INFO:teuthology.orchestra.run.smithi164.stdout:(25/32): ceph-common-19.0.0-3080.gc2d8c315.el9. 7.3 MB/s | 21 MB 00:02 2024-04-15T14:46:35.353 INFO:teuthology.orchestra.run.smithi164.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 299 kB/s | 67 kB 00:00 2024-04-15T14:46:35.412 INFO:teuthology.orchestra.run.smithi164.stdout:(27/32): libarrow-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2024-04-15T14:46:35.454 INFO:teuthology.orchestra.run.smithi164.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-15T14:46:35.612 INFO:teuthology.orchestra.run.smithi164.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-04-15T14:46:35.954 INFO:teuthology.orchestra.run.smithi164.stdout:(30/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.3 MB/s | 838 kB 00:00 2024-04-15T14:46:36.188 INFO:teuthology.orchestra.run.smithi164.stdout:(31/32): librados2-19.0.0-3080.gc2d8c315.el9.x8 4.6 MB/s | 3.4 MB 00:00 2024-04-15T14:46:36.309 INFO:teuthology.orchestra.run.smithi038.stdout:(1/32): ceph-base-19.0.0-3080.gc2d8c315.el9.x86 5.8 MB/s | 5.4 MB 00:00 2024-04-15T14:46:36.359 INFO:teuthology.orchestra.run.smithi038.stdout:(2/32): ceph-selinux-19.0.0-3080.gc2d8c315.el9. 506 kB/s | 25 kB 00:00 2024-04-15T14:46:36.363 INFO:teuthology.orchestra.run.smithi164.stdout:(32/32): librbd1-19.0.0-3080.gc2d8c315.el9.x86_ 4.2 MB/s | 3.1 MB 00:00 2024-04-15T14:46:36.366 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:46:36.366 INFO:teuthology.orchestra.run.smithi164.stdout:Total 15 MB/s | 60 MB 00:04 2024-04-15T14:46:36.367 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:46:36.405 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:46:36.405 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:46:36.459 INFO:teuthology.orchestra.run.smithi038.stdout:(3/32): libcephfs2-19.0.0-3080.gc2d8c315.el9.x8 7.3 MB/s | 747 kB 00:00 2024-04-15T14:46:36.551 INFO:teuthology.orchestra.run.smithi038.stdout:(4/32): libradosstriper1-19.0.0-3080.gc2d8c315. 5.3 MB/s | 501 kB 00:00 2024-04-15T14:46:36.890 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:46:36.891 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:46:37.026 INFO:teuthology.orchestra.run.smithi038.stdout:(5/32): librgw2-19.0.0-3080.gc2d8c315.el9.x86_6 11 MB/s | 5.4 MB 00:00 2024-04-15T14:46:37.085 INFO:teuthology.orchestra.run.smithi038.stdout:(6/32): python3-ceph-argparse-19.0.0-3080.gc2d8 775 kB/s | 45 kB 00:00 2024-04-15T14:46:37.160 INFO:teuthology.orchestra.run.smithi038.stdout:(7/32): python3-ceph-common-19.0.0-3080.gc2d8c3 1.8 MB/s | 135 kB 00:00 2024-04-15T14:46:37.227 INFO:teuthology.orchestra.run.smithi038.stdout:(8/32): python3-cephfs-19.0.0-3080.gc2d8c315.el 2.4 MB/s | 162 kB 00:00 2024-04-15T14:46:37.311 INFO:teuthology.orchestra.run.smithi038.stdout:(9/32): python3-rados-19.0.0-3080.gc2d8c315.el9 3.8 MB/s | 320 kB 00:00 2024-04-15T14:46:37.378 INFO:teuthology.orchestra.run.smithi038.stdout:(10/32): python3-rbd-19.0.0-3080.gc2d8c315.el9. 4.4 MB/s | 298 kB 00:00 2024-04-15T14:46:37.420 INFO:teuthology.orchestra.run.smithi038.stdout:(11/32): python3-rgw-19.0.0-3080.gc2d8c315.el9. 2.3 MB/s | 100 kB 00:00 2024-04-15T14:46:37.620 INFO:teuthology.orchestra.run.smithi038.stdout:(12/32): ceph-common-19.0.0-3080.gc2d8c315.el9. 9.4 MB/s | 21 MB 00:02 2024-04-15T14:46:37.729 INFO:teuthology.orchestra.run.smithi038.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 343 kB/s | 106 kB 00:00 2024-04-15T14:46:37.762 INFO:teuthology.orchestra.run.smithi038.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-15T14:46:37.788 INFO:teuthology.orchestra.run.smithi038.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2024-04-15T14:46:37.846 INFO:teuthology.orchestra.run.smithi038.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2024-04-15T14:46:37.872 INFO:teuthology.orchestra.run.smithi038.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-04-15T14:46:37.897 INFO:teuthology.orchestra.run.smithi038.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 824 kB/s | 41 kB 00:00 2024-04-15T14:46:37.922 INFO:teuthology.orchestra.run.smithi038.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-15T14:46:37.947 INFO:teuthology.orchestra.run.smithi038.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 698 kB/s | 35 kB 00:00 2024-04-15T14:46:37.973 INFO:teuthology.orchestra.run.smithi038.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 922 kB/s | 46 kB 00:00 2024-04-15T14:46:38.073 INFO:teuthology.orchestra.run.smithi038.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.4 MB/s | 309 kB 00:00 2024-04-15T14:46:38.107 INFO:teuthology.orchestra.run.smithi038.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 781 kB/s | 26 kB 00:00 2024-04-15T14:46:38.149 INFO:teuthology.orchestra.run.smithi038.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-04-15T14:46:38.216 INFO:teuthology.orchestra.run.smithi038.stdout:(25/32): libarrow-9.0.0-10.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-04-15T14:46:38.241 INFO:teuthology.orchestra.run.smithi038.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-04-15T14:46:38.283 INFO:teuthology.orchestra.run.smithi038.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2024-04-15T14:46:38.308 INFO:teuthology.orchestra.run.smithi038.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-15T14:46:38.350 INFO:teuthology.orchestra.run.smithi038.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-15T14:46:38.400 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:46:38.492 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-15T14:46:38.518 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-15T14:46:38.543 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-15T14:46:38.574 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-15T14:46:38.592 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-15T14:46:38.642 INFO:teuthology.orchestra.run.smithi038.stdout:(30/32): librados2-19.0.0-3080.gc2d8c315.el9.x8 10 MB/s | 3.4 MB 00:00 2024-04-15T14:46:38.726 INFO:teuthology.orchestra.run.smithi038.stdout:(31/32): librbd1-19.0.0-3080.gc2d8c315.el9.x86_ 8.4 MB/s | 3.1 MB 00:00 2024-04-15T14:46:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-15T14:46:38.838 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-15T14:46:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-15T14:46:39.228 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 7/34 2024-04-15T14:46:39.317 INFO:teuthology.orchestra.run.smithi038.stdout:(32/32): ceph-radosgw-19.0.0-3080.gc2d8c315.el9 2.7 MB/s | 11 MB 00:03 2024-04-15T14:46:39.318 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 7/34 2024-04-15T14:46:39.323 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:46:39.323 INFO:teuthology.orchestra.run.smithi038.stdout:Total 15 MB/s | 60 MB 00:04 2024-04-15T14:46:39.323 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:46:39.366 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:46:39.366 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:46:39.412 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.0.0-3080.gc2d8c315.el9.x86_64 8/34 2024-04-15T14:46:39.438 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 9/34 2024-04-15T14:46:39.492 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 9/34 2024-04-15T14:46:39.521 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-15T14:46:39.564 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.0.0-3080.gc2d8c315.el9. 11/34 2024-04-15T14:46:39.641 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.0.0-3080.gc2d8c315.el9.x86_64 12/34 2024-04-15T14:46:39.665 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.0.0-3080.gc2d8c315.el9.x86_6 13/34 2024-04-15T14:46:39.729 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3080.gc2d8c315.el9.x86_6 13/34 2024-04-15T14:46:39.763 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-15T14:46:39.878 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-15T14:46:39.879 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:46:39.879 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:46:39.916 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-15T14:46:39.969 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-15T14:46:39.988 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-15T14:46:40.017 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-15T14:46:40.050 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-15T14:46:40.379 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-15T14:46:40.404 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 22/34 2024-04-15T14:46:40.494 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 22/34 2024-04-15T14:46:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 23/34 2024-04-15T14:46:40.569 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-15T14:46:41.061 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-15T14:46:41.082 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.0.0-3080.gc2d8c315.el9.x86_64 26/34 2024-04-15T14:46:41.146 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.0.0-3080.gc2d8c315.el9.x86_64 26/34 2024-04-15T14:46:41.221 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 27/34 2024-04-15T14:46:41.251 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.0.0-3080.gc2d8c315.el9.x8 28/34 2024-04-15T14:46:41.421 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:46:41.525 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-15T14:46:41.556 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-15T14:46:41.581 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-15T14:46:41.604 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-15T14:46:41.622 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-15T14:46:41.772 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-15T14:46:41.827 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-15T14:46:42.231 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-15T14:46:42.258 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 7/34 2024-04-15T14:46:42.351 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 7/34 2024-04-15T14:46:42.441 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:19.0.0-3080.gc2d8c315.el9.x86_64 8/34 2024-04-15T14:46:42.468 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 9/34 2024-04-15T14:46:42.530 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 9/34 2024-04-15T14:46:42.560 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-15T14:46:42.603 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:19.0.0-3080.gc2d8c315.el9. 11/34 2024-04-15T14:46:42.674 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:19.0.0-3080.gc2d8c315.el9.x86_64 12/34 2024-04-15T14:46:42.695 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:19.0.0-3080.gc2d8c315.el9.x86_6 13/34 2024-04-15T14:46:42.743 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3080.gc2d8c315.el9.x86_6 13/34 2024-04-15T14:46:42.778 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-15T14:46:42.889 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-15T14:46:42.920 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-15T14:46:42.961 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-15T14:46:42.993 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-15T14:46:43.022 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-15T14:46:43.055 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-15T14:46:43.385 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-15T14:46:43.418 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 22/34 2024-04-15T14:46:43.508 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 22/34 2024-04-15T14:46:43.539 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 23/34 2024-04-15T14:46:43.556 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 29/34 2024-04-15T14:46:43.586 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-15T14:46:43.597 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 29/34 2024-04-15T14:46:44.090 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-15T14:46:44.120 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:19.0.0-3080.gc2d8c315.el9.x86_64 26/34 2024-04-15T14:46:44.148 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 29/34 2024-04-15T14:46:44.183 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:19.0.0-3080.gc2d8c315.el9.x86_64 26/34 2024-04-15T14:46:44.184 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 30/34 2024-04-15T14:46:44.264 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 27/34 2024-04-15T14:46:44.291 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 30/34 2024-04-15T14:46:44.291 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T14:46:44.292 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T14:46:44.292 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:46:44.298 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:19.0.0-3080.gc2d8c315.el9.x8 28/34 2024-04-15T14:46:44.335 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.0.0-3080.gc2d8c315.el9.x86_64 31/34 2024-04-15T14:46:46.687 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 29/34 2024-04-15T14:46:46.719 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 29/34 2024-04-15T14:46:47.309 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 29/34 2024-04-15T14:46:47.348 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 30/34 2024-04-15T14:46:47.427 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 30/34 2024-04-15T14:46:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T14:46:47.428 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T14:46:47.428 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:46:47.591 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:19.0.0-3080.gc2d8c315.el9.x86_64 31/34 2024-04-15T14:46:53.787 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3080.gc2d8c315.el9.x86_64 31/34 2024-04-15T14:46:53.787 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-04-15T14:46:53.787 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-04-15T14:46:53.788 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-04-15T14:46:53.788 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-04-15T14:46:53.788 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-04-15T14:46:53.788 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-04-15T14:46:53.788 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-04-15T14:46:53.788 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:46:54.779 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 32/34 2024-04-15T14:46:54.805 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 32/34 2024-04-15T14:46:54.805 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:46:54.805 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T14:46:54.805 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T14:46:54.805 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T14:46:54.805 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:46:54.807 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-15T14:46:54.873 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-15T14:46:54.873 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-15T14:46:55.982 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-15T14:46:55.982 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/34 2024-04-15T14:46:55.982 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/34 2024-04-15T14:46:55.982 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 3/34 2024-04-15T14:46:55.982 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.0.0-3080.gc2d8c315.el9.x86_64 4/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 5/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.0.0-3080.gc2d8c315.el9.x86_6 6/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.0.0-3080.gc2d8c315.el9.x86_64 7/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3080.gc2d8c315.el9. 8/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.0.0-3080.gc2d8c315.el9.x8 9/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.0.0-3080.gc2d8c315.el9.x86_64 10/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.0.0-3080.gc2d8c315.el9.x86_64 11/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 12/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 13/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-15T14:46:55.983 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-15T14:46:55.984 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-15T14:46:55.985 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-15T14:46:55.985 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 31/34 2024-04-15T14:46:55.985 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-15T14:46:55.985 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 33/34 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.119 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T14:46:57.120 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:46:57.121 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:46:57.433 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-test 2024-04-15T14:46:57.768 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3080.gc2d8c315.el9.x86_64 31/34 2024-04-15T14:46:57.768 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2024-04-15T14:46:57.768 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2024-04-15T14:46:57.768 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2024-04-15T14:46:57.768 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2024-04-15T14:46:57.768 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2024-04-15T14:46:57.769 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /root 2024-04-15T14:46:57.769 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2024-04-15T14:46:57.769 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:46:58.003 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:29 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:46:58.157 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:46:58.158 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:46:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:46:58.158 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:46:58.158 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:46:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 49 M 2024-04-15T14:46:58.158 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:46:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T14:46:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 163 k 2024-04-15T14:46:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-15T14:46:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-15T14:46:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-15T14:46:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:46:58.159 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:46:58.159 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:46:58.159 INFO:teuthology.orchestra.run.smithi164.stdout:Install 6 Packages 2024-04-15T14:46:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:46:58.160 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 50 M 2024-04-15T14:46:58.160 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 212 M 2024-04-15T14:46:58.160 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:46:58.627 INFO:teuthology.orchestra.run.smithi164.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2024-04-15T14:46:58.702 INFO:teuthology.orchestra.run.smithi164.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-04-15T14:46:58.727 INFO:teuthology.orchestra.run.smithi164.stdout:(3/6): libcephsqlite-19.0.0-3080.gc2d8c315.el9. 608 kB/s | 163 kB 00:00 2024-04-15T14:46:58.753 INFO:teuthology.orchestra.run.smithi164.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-04-15T14:46:58.776 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 32/34 2024-04-15T14:46:58.808 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 32/34 2024-04-15T14:46:58.808 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:46:58.808 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T14:46:58.808 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T14:46:58.808 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T14:46:58.808 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:46:58.810 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-15T14:46:58.861 INFO:teuthology.orchestra.run.smithi164.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2024-04-15T14:46:58.890 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-15T14:46:58.890 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 3/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:19.0.0-3080.gc2d8c315.el9.x86_64 4/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 5/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:19.0.0-3080.gc2d8c315.el9.x86_6 6/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:19.0.0-3080.gc2d8c315.el9.x86_64 7/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3080.gc2d8c315.el9. 8/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:19.0.0-3080.gc2d8c315.el9.x8 9/34 2024-04-15T14:47:00.057 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:19.0.0-3080.gc2d8c315.el9.x86_64 10/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:19.0.0-3080.gc2d8c315.el9.x86_64 11/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 12/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 13/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-15T14:47:00.058 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-15T14:47:00.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-15T14:47:00.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-15T14:47:00.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-15T14:47:00.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-15T14:47:00.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-15T14:47:00.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-15T14:47:00.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 31/34 2024-04-15T14:47:00.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-15T14:47:00.059 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 33/34 2024-04-15T14:47:01.070 INFO:teuthology.orchestra.run.smithi164.stdout:(6/6): ceph-test-19.0.0-3080.gc2d8c315.el9.x86_ 19 MB/s | 49 MB 00:02 2024-04-15T14:47:01.073 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:01.073 INFO:teuthology.orchestra.run.smithi164.stdout:Total 17 MB/s | 50 MB 00:02 2024-04-15T14:47:01.088 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:47:01.109 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:47:01.110 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:47:01.215 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-15T14:47:01.215 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:01.215 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T14:47:01.216 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.217 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:01.218 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-15T14:47:01.218 INFO:teuthology.orchestra.run.smithi038.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-15T14:47:01.218 INFO:teuthology.orchestra.run.smithi038.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-15T14:47:01.218 INFO:teuthology.orchestra.run.smithi038.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T14:47:01.218 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T14:47:01.218 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:01.218 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:47:01.502 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:47:01.503 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:47:01.559 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-test 2024-04-15T14:47:02.089 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:47:02.144 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:30 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:47:02.172 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-15T14:47:02.214 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-15T14:47:02.253 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-15T14:47:02.295 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-15T14:47:02.313 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:47:02.313 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:47:02.313 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 49 M 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 163 k 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:47:02.314 INFO:teuthology.orchestra.run.smithi038.stdout:Install 6 Packages 2024-04-15T14:47:02.315 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:02.315 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 50 M 2024-04-15T14:47:02.315 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 212 M 2024-04-15T14:47:02.315 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:47:02.322 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.0.0-3080.gc2d8c315.el9.x86_64 5/6 2024-04-15T14:47:02.528 INFO:teuthology.orchestra.run.smithi038.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2024-04-15T14:47:02.579 INFO:teuthology.orchestra.run.smithi038.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 300 kB 00:00 2024-04-15T14:47:02.622 INFO:teuthology.orchestra.run.smithi038.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-04-15T14:47:02.754 INFO:teuthology.orchestra.run.smithi038.stdout:(4/6): jq-1.6-16.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2024-04-15T14:47:02.779 INFO:teuthology.orchestra.run.smithi038.stdout:(5/6): libcephsqlite-19.0.0-3080.gc2d8c315.el9. 407 kB/s | 163 kB 00:00 2024-04-15T14:47:05.913 INFO:teuthology.orchestra.run.smithi038.stdout:(6/6): ceph-test-19.0.0-3080.gc2d8c315.el9.x86_ 14 MB/s | 49 MB 00:03 2024-04-15T14:47:05.915 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:05.916 INFO:teuthology.orchestra.run.smithi038.stdout:Total 14 MB/s | 50 MB 00:03 2024-04-15T14:47:05.931 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:47:05.954 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:47:05.955 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:47:06.359 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:47:06.359 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:47:06.959 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:47:06.973 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3080.gc2d8c315.el9.x86_64 5/6 2024-04-15T14:47:07.032 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-15T14:47:07.055 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.0.0-3080.gc2d8c315.el9.x86_64 6/6 2024-04-15T14:47:07.064 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-15T14:47:07.103 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-15T14:47:07.138 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-15T14:47:07.166 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:19.0.0-3080.gc2d8c315.el9.x86_64 5/6 2024-04-15T14:47:09.463 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-test-2:19.0.0-3080.gc2d8c315.el9.x86_64 6/6 2024-04-15T14:47:09.464 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/6 2024-04-15T14:47:09.464 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/6 2024-04-15T14:47:09.464 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-15T14:47:09.464 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-15T14:47:09.464 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-15T14:47:09.887 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-15T14:47:09.887 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:09.887 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:47:09.887 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:09.888 INFO:teuthology.orchestra.run.smithi164.stdout: jq-1.6-16.el9.x86_64 2024-04-15T14:47:09.888 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:09.888 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T14:47:09.888 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-15T14:47:09.888 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T14:47:09.888 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:09.888 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:10.208 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph 2024-04-15T14:47:10.823 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:41 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:10.986 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:10.989 INFO:teuthology.orchestra.run.smithi164.stdout:========================================================================================= 2024-04-15T14:47:10.989 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:47:10.989 INFO:teuthology.orchestra.run.smithi164.stdout:========================================================================================= 2024-04-15T14:47:10.989 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:47:10.989 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 6.6 k 2024-04-15T14:47:10.989 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:47:10.989 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 2.4 M 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 1.5 M 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 249 k 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 4.7 M 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 17 M 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T14:47:10.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T14:47:10.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:10.992 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:47:10.993 INFO:teuthology.orchestra.run.smithi164.stdout:========================================================================================= 2024-04-15T14:47:10.993 INFO:teuthology.orchestra.run.smithi164.stdout:Install 36 Packages 2024-04-15T14:47:10.993 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:10.994 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 30 M 2024-04-15T14:47:10.995 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 107 M 2024-04-15T14:47:10.995 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:47:11.383 INFO:teuthology.orchestra.run.smithi164.stdout:(1/36): ceph-19.0.0-3080.gc2d8c315.el9.x86_64.r 39 kB/s | 6.6 kB 00:00 2024-04-15T14:47:11.817 INFO:teuthology.orchestra.run.smithi164.stdout:(2/36): ceph-mon-19.0.0-3080.gc2d8c315.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-04-15T14:47:11.892 INFO:teuthology.orchestra.run.smithi164.stdout:(3/36): ceph-mgr-19.0.0-3080.gc2d8c315.el9.x86_ 2.2 MB/s | 1.5 MB 00:00 2024-04-15T14:47:11.942 INFO:teuthology.orchestra.run.smithi164.stdout:(4/36): ceph-mds-19.0.0-3080.gc2d8c315.el9.x86_ 3.2 MB/s | 2.4 MB 00:00 2024-04-15T14:47:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:(5/36): ceph-mgr-modules-core-19.0.0-3080.gc2d8 2.2 MB/s | 249 kB 00:00 2024-04-15T14:47:12.062 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3080.gc2d8c315.el9.x86_64 5/6 2024-04-15T14:47:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:(6/36): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2024-04-15T14:47:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:(7/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2024-04-15T14:47:12.119 INFO:teuthology.orchestra.run.smithi164.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 624 kB/s | 32 kB 00:00 2024-04-15T14:47:12.142 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:19.0.0-3080.gc2d8c315.el9.x86_64 6/6 2024-04-15T14:47:12.143 INFO:teuthology.orchestra.run.smithi164.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 938 kB/s | 47 kB 00:00 2024-04-15T14:47:12.169 INFO:teuthology.orchestra.run.smithi164.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 771 kB/s | 39 kB 00:00 2024-04-15T14:47:12.194 INFO:teuthology.orchestra.run.smithi164.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-04-15T14:47:12.244 INFO:teuthology.orchestra.run.smithi164.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 15 MB/s | 1.1 MB 00:00 2024-04-15T14:47:12.270 INFO:teuthology.orchestra.run.smithi164.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-04-15T14:47:12.295 INFO:teuthology.orchestra.run.smithi164.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-04-15T14:47:12.321 INFO:teuthology.orchestra.run.smithi164.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-04-15T14:47:12.488 INFO:teuthology.orchestra.run.smithi164.stdout:(16/36): python3-requests-2.25.1-8.el9.noarch.r 652 kB/s | 125 kB 00:00 2024-04-15T14:47:12.666 INFO:teuthology.orchestra.run.smithi164.stdout:(17/36): ceph-osd-19.0.0-3080.gc2d8c315.el9.x86 20 MB/s | 17 MB 00:00 2024-04-15T14:47:12.971 INFO:teuthology.orchestra.run.smithi164.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 166 kB/s | 43 kB 00:00 2024-04-15T14:47:13.030 INFO:teuthology.orchestra.run.smithi164.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 279 kB/s | 151 kB 00:00 2024-04-15T14:47:13.055 INFO:teuthology.orchestra.run.smithi164.stdout:(20/36): lua-devel-5.4.4-4.el9.x86_64.rpm 30 kB/s | 22 kB 00:00 2024-04-15T14:47:13.147 INFO:teuthology.orchestra.run.smithi164.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 978 kB/s | 172 kB 00:00 2024-04-15T14:47:13.189 INFO:teuthology.orchestra.run.smithi164.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-04-15T14:47:13.222 INFO:teuthology.orchestra.run.smithi164.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2024-04-15T14:47:13.265 INFO:teuthology.orchestra.run.smithi164.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 311 kB/s | 23 kB 00:00 2024-04-15T14:47:13.290 INFO:teuthology.orchestra.run.smithi164.stdout:(25/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 46 kB/s | 11 kB 00:00 2024-04-15T14:47:13.315 INFO:teuthology.orchestra.run.smithi164.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 211 kB/s | 19 kB 00:00 2024-04-15T14:47:13.340 INFO:teuthology.orchestra.run.smithi164.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-04-15T14:47:13.399 INFO:teuthology.orchestra.run.smithi164.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 941 kB/s | 79 kB 00:00 2024-04-15T14:47:13.432 INFO:teuthology.orchestra.run.smithi164.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-15T14:47:13.466 INFO:teuthology.orchestra.run.smithi164.stdout:(30/36): python3-logutils-0.3.5-21.el9.noarch.r 263 kB/s | 46 kB 00:00 2024-04-15T14:47:13.491 INFO:teuthology.orchestra.run.smithi164.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 178 kB/s | 16 kB 00:00 2024-04-15T14:47:13.516 INFO:teuthology.orchestra.run.smithi164.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2024-04-15T14:47:13.558 INFO:teuthology.orchestra.run.smithi164.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 387 kB/s | 36 kB 00:00 2024-04-15T14:47:13.601 INFO:teuthology.orchestra.run.smithi164.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-15T14:47:13.643 INFO:teuthology.orchestra.run.smithi164.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-04-15T14:47:13.667 INFO:teuthology.orchestra.run.smithi164.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 183 kB/s | 20 kB 00:00 2024-04-15T14:47:13.673 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:13.673 INFO:teuthology.orchestra.run.smithi164.stdout:Total 11 MB/s | 30 MB 00:02 2024-04-15T14:47:13.699 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:47:13.732 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:47:13.733 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:47:14.139 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:47:14.140 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:47:14.561 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-test-2:19.0.0-3080.gc2d8c315.el9.x86_64 6/6 2024-04-15T14:47:14.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/6 2024-04-15T14:47:14.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/6 2024-04-15T14:47:14.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-15T14:47:14.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-15T14:47:14.561 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout: jq-1.6-16.el9.x86_64 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T14:47:14.909 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:14.910 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:47:15.234 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph 2024-04-15T14:47:15.511 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:47:15.587 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-15T14:47:15.619 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-15T14:47:15.659 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-15T14:47:15.734 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-15T14:47:15.771 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-15T14:47:15.804 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-15T14:47:15.822 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:43 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:47:15.894 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-15T14:47:15.974 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-15T14:47:15.982 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout:========================================================================================= 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout:========================================================================================= 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 6.6 k 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 2.4 M 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 1.5 M 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 249 k 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 4.7 M 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 17 M 2024-04-15T14:47:15.985 INFO:teuthology.orchestra.run.smithi038.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T14:47:15.986 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T14:47:15.987 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-15T14:47:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-15T14:47:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T14:47:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T14:47:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T14:47:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:15.988 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:47:15.988 INFO:teuthology.orchestra.run.smithi038.stdout:========================================================================================= 2024-04-15T14:47:15.988 INFO:teuthology.orchestra.run.smithi038.stdout:Install 36 Packages 2024-04-15T14:47:15.988 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:15.989 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 30 M 2024-04-15T14:47:15.989 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 107 M 2024-04-15T14:47:15.989 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:47:16.016 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-15T14:47:16.086 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-15T14:47:16.141 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-04-15T14:47:16.179 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-04-15T14:47:16.227 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-04-15T14:47:16.283 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-04-15T14:47:16.477 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-04-15T14:47:16.525 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-04-15T14:47:16.562 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-04-15T14:47:16.599 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-04-15T14:47:16.629 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-04-15T14:47:16.697 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-04-15T14:47:16.731 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-15T14:47:16.764 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-04-15T14:47:16.805 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-04-15T14:47:16.815 INFO:teuthology.orchestra.run.smithi038.stdout:(1/36): ceph-19.0.0-3080.gc2d8c315.el9.x86_64.r 39 kB/s | 6.6 kB 00:00 2024-04-15T14:47:16.840 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-04-15T14:47:16.874 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-04-15T14:47:16.963 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-04-15T14:47:17.006 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-04-15T14:47:17.057 INFO:teuthology.orchestra.run.smithi038.stdout:(2/36): ceph-mds-19.0.0-3080.gc2d8c315.el9.x86_ 5.7 MB/s | 2.4 MB 00:00 2024-04-15T14:47:17.078 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-04-15T14:47:17.223 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-04-15T14:47:17.350 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-15T14:47:17.382 INFO:teuthology.orchestra.run.smithi038.stdout:(3/36): ceph-mon-19.0.0-3080.gc2d8c315.el9.x86_ 8.3 MB/s | 4.7 MB 00:00 2024-04-15T14:47:17.458 INFO:teuthology.orchestra.run.smithi038.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3080.gc2d8 3.2 MB/s | 249 kB 00:00 2024-04-15T14:47:17.515 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3080.gc2d8c315.el9. 31/36 2024-04-15T14:47:17.554 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 32/36 2024-04-15T14:47:17.567 INFO:teuthology.orchestra.run.smithi038.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2024-04-15T14:47:17.578 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 32/36 2024-04-15T14:47:17.579 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:17.579 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T14:47:17.579 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T14:47:17.579 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T14:47:17.579 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:17.608 INFO:teuthology.orchestra.run.smithi038.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-04-15T14:47:17.634 INFO:teuthology.orchestra.run.smithi038.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2024-04-15T14:47:17.659 INFO:teuthology.orchestra.run.smithi038.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2024-04-15T14:47:17.684 INFO:teuthology.orchestra.run.smithi038.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2024-04-15T14:47:17.726 INFO:teuthology.orchestra.run.smithi038.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2024-04-15T14:47:17.793 INFO:teuthology.orchestra.run.smithi038.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 17 MB/s | 1.1 MB 00:00 2024-04-15T14:47:17.968 INFO:teuthology.orchestra.run.smithi038.stdout:(12/36): ceph-osd-19.0.0-3080.gc2d8c315.el9.x86 18 MB/s | 17 MB 00:00 2024-04-15T14:47:17.994 INFO:teuthology.orchestra.run.smithi038.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 513 kB/s | 103 kB 00:00 2024-04-15T14:47:18.019 INFO:teuthology.orchestra.run.smithi038.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-04-15T14:47:18.045 INFO:teuthology.orchestra.run.smithi038.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-04-15T14:47:18.078 INFO:teuthology.orchestra.run.smithi038.stdout:(16/36): ceph-mgr-19.0.0-3080.gc2d8c315.el9.x86 1.0 MB/s | 1.5 MB 00:01 2024-04-15T14:47:18.170 INFO:teuthology.orchestra.run.smithi038.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-04-15T14:47:18.228 INFO:teuthology.orchestra.run.smithi038.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-15T14:47:18.262 INFO:teuthology.orchestra.run.smithi038.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 478 kB/s | 43 kB 00:00 2024-04-15T14:47:18.287 INFO:teuthology.orchestra.run.smithi038.stdout:(20/36): python3-requests-2.25.1-8.el9.noarch.r 467 kB/s | 125 kB 00:00 2024-04-15T14:47:18.337 INFO:teuthology.orchestra.run.smithi038.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-04-15T14:47:18.363 INFO:teuthology.orchestra.run.smithi038.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 142 kB/s | 11 kB 00:00 2024-04-15T14:47:18.388 INFO:teuthology.orchestra.run.smithi038.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-04-15T14:47:18.421 INFO:teuthology.orchestra.run.smithi038.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 396 kB/s | 23 kB 00:00 2024-04-15T14:47:18.447 INFO:teuthology.orchestra.run.smithi038.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 331 kB/s | 19 kB 00:00 2024-04-15T14:47:18.472 INFO:teuthology.orchestra.run.smithi038.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-04-15T14:47:18.497 INFO:teuthology.orchestra.run.smithi038.stdout:(27/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-04-15T14:47:18.522 INFO:teuthology.orchestra.run.smithi038.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 615 kB/s | 46 kB 00:00 2024-04-15T14:47:18.548 INFO:teuthology.orchestra.run.smithi038.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-04-15T14:47:18.573 INFO:teuthology.orchestra.run.smithi038.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-04-15T14:47:18.615 INFO:teuthology.orchestra.run.smithi038.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 861 kB/s | 36 kB 00:00 2024-04-15T14:47:18.640 INFO:teuthology.orchestra.run.smithi038.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 976 kB/s | 90 kB 00:00 2024-04-15T14:47:18.674 INFO:teuthology.orchestra.run.smithi038.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-04-15T14:47:18.716 INFO:teuthology.orchestra.run.smithi038.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 478 kB/s | 20 kB 00:00 2024-04-15T14:47:18.741 INFO:teuthology.orchestra.run.smithi038.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-04-15T14:47:18.858 INFO:teuthology.orchestra.run.smithi038.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.9 MB/s | 427 kB 00:00 2024-04-15T14:47:18.863 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:18.864 INFO:teuthology.orchestra.run.smithi038.stdout:Total 10 MB/s | 30 MB 00:02 2024-04-15T14:47:18.888 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:47:18.934 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:47:18.934 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:47:19.028 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.0.0-3080.gc2d8c315.el9.x86_64 33/36 2024-04-15T14:47:19.056 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.0.0-3080.gc2d8c315.el9.x86_64 33/36 2024-04-15T14:47:19.056 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:19.056 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T14:47:19.056 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T14:47:19.056 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T14:47:19.056 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:19.356 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:47:19.357 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:47:19.496 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.0.0-3080.gc2d8c315.el9.x86_64 34/36 2024-04-15T14:47:19.520 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.0.0-3080.gc2d8c315.el9.x86_64 34/36 2024-04-15T14:47:19.520 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:19.520 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T14:47:19.520 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T14:47:19.520 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T14:47:19.520 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:19.746 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.0.0-3080.gc2d8c315.el9.x86_64 35/36 2024-04-15T14:47:19.770 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.0.0-3080.gc2d8c315.el9.x86_64 35/36 2024-04-15T14:47:19.770 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:19.771 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T14:47:19.771 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T14:47:19.771 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T14:47:19.771 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:19.836 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.0.0-3080.gc2d8c315.el9.x86_64 36/36 2024-04-15T14:47:20.707 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:47:20.761 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-15T14:47:20.802 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-15T14:47:20.830 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-15T14:47:20.902 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-15T14:47:20.937 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-15T14:47:20.970 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-15T14:47:21.064 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-15T14:47:21.134 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-15T14:47:21.190 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-15T14:47:21.263 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-15T14:47:21.317 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-04-15T14:47:21.354 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-04-15T14:47:21.413 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-04-15T14:47:21.475 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-04-15T14:47:21.613 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-2:19.0.0-3080.gc2d8c315.el9.x86_64 36/36 2024-04-15T14:47:21.613 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/36 2024-04-15T14:47:21.613 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/36 2024-04-15T14:47:21.613 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 3/36 2024-04-15T14:47:21.613 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.0.0-3080.gc2d8c315.el9.x86_64 4/36 2024-04-15T14:47:21.613 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.0.0-3080.gc2d8c315.el9.x86_64 5/36 2024-04-15T14:47:21.613 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3080.gc2d8c315.el9. 6/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-15T14:47:21.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-15T14:47:21.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-15T14:47:21.616 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-15T14:47:21.616 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-15T14:47:21.673 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-04-15T14:47:21.724 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-04-15T14:47:21.763 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-04-15T14:47:21.797 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-04-15T14:47:21.827 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-04-15T14:47:21.906 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-04-15T14:47:21.954 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-15T14:47:21.987 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-04-15T14:47:22.028 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-04-15T14:47:22.063 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-04-15T14:47:22.097 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-04-15T14:47:22.191 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-04-15T14:47:22.228 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-04-15T14:47:22.302 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-04-15T14:47:22.443 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-04-15T14:47:22.575 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-15T14:47:22.699 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-15T14:47:22.699 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:22.701 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:47:22.701 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:22.701 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:22.701 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:22.701 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:22.701 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T14:47:22.702 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T14:47:22.703 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T14:47:22.704 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T14:47:22.704 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T14:47:22.704 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T14:47:22.704 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T14:47:22.704 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T14:47:22.704 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T14:47:22.704 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T14:47:22.704 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:22.704 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:22.744 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3080.gc2d8c315.el9. 31/36 2024-04-15T14:47:22.774 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 32/36 2024-04-15T14:47:22.800 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 32/36 2024-04-15T14:47:22.800 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:22.800 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T14:47:22.800 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T14:47:22.800 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T14:47:22.800 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:23.098 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-base 2024-04-15T14:47:23.691 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:54 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:23.791 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:47:23.844 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:23.845 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:47:23.845 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:23.910 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install cephadm 2024-04-15T14:47:24.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:19.0.0-3080.gc2d8c315.el9.x86_64 33/36 2024-04-15T14:47:24.343 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:19.0.0-3080.gc2d8c315.el9.x86_64 33/36 2024-04-15T14:47:24.345 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:24.345 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T14:47:24.346 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T14:47:24.346 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T14:47:24.346 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:24.484 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:55 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:24.638 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:24.638 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 762 k 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 762 k 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 769 k 2024-04-15T14:47:24.639 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:47:24.809 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:19.0.0-3080.gc2d8c315.el9.x86_64 34/36 2024-04-15T14:47:24.833 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:19.0.0-3080.gc2d8c315.el9.x86_64 34/36 2024-04-15T14:47:24.833 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:24.833 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T14:47:24.833 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T14:47:24.833 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T14:47:24.833 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:24.907 INFO:teuthology.orchestra.run.smithi164.stdout:cephadm-19.0.0-3080.gc2d8c315.el9.noarch.rpm 2.8 MB/s | 762 kB 00:00 2024-04-15T14:47:24.908 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:24.908 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.8 MB/s | 762 kB 00:00 2024-04-15T14:47:24.909 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:47:24.913 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:47:24.914 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:47:24.919 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:47:24.920 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:47:24.990 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:47:25.076 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:19.0.0-3080.gc2d8c315.el9.x86_64 35/36 2024-04-15T14:47:25.100 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:19.0.0-3080.gc2d8c315.el9.x86_64 35/36 2024-04-15T14:47:25.100 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:25.100 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T14:47:25.100 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T14:47:25.101 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T14:47:25.101 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:25.168 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:19.0.0-3080.gc2d8c315.el9.x86_64 36/36 2024-04-15T14:47:25.401 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/1 2024-04-15T14:47:25.488 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/1 2024-04-15T14:47:25.892 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/1 2024-04-15T14:47:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/1 2024-04-15T14:47:26.229 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:26.229 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:47:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:26.230 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:26.230 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:26.448 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-immutable-object-cache 2024-04-15T14:47:27.036 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:58 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-2:19.0.0-3080.gc2d8c315.el9.x86_64 36/36 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/36 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/36 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 3/36 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:19.0.0-3080.gc2d8c315.el9.x86_64 4/36 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:19.0.0-3080.gc2d8c315.el9.x86_64 5/36 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3080.gc2d8c315.el9. 6/36 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-04-15T14:47:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-15T14:47:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-15T14:47:27.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-15T14:47:27.124 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-15T14:47:27.188 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:27.189 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:27.189 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:47:27.189 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:27.189 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:47:27.189 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 145 k 2024-04-15T14:47:27.190 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:27.190 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:47:27.190 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:27.190 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:47:27.190 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:27.190 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 145 k 2024-04-15T14:47:27.190 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 435 k 2024-04-15T14:47:27.190 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:47:27.539 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-immutable-object-cache-19.0.0-3080.gc2d8c3 416 kB/s | 145 kB 00:00 2024-04-15T14:47:27.540 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:27.540 INFO:teuthology.orchestra.run.smithi164.stdout:Total 414 kB/s | 145 kB 00:00 2024-04-15T14:47:27.540 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:47:27.548 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:47:27.548 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:47:27.601 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:47:27.601 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:47:27.747 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:47:27.807 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3080.gc2d8c315. 1/1 2024-04-15T14:47:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3080.gc2d8c315. 1/1 2024-04-15T14:47:27.832 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:27.832 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T14:47:27.832 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:27.887 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-15T14:47:27.887 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:27.887 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:47:27.887 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: lua-5.4.4-4.el9.x86_64 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T14:47:27.888 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T14:47:27.889 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:27.890 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:47:28.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-base 2024-04-15T14:47:28.818 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:56 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:47:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3080.gc2d8c315. 1/1 2024-04-15T14:47:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:28.819 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:47:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:28.819 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:28.819 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:28.921 INFO:teuthology.orchestra.run.smithi038.stdout:Package ceph-base-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:47:28.977 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:47:28.978 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:47:28.978 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:47:29.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install cephadm 2024-04-15T14:47:29.064 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr 2024-04-15T14:47:29.628 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:57 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:47:29.656 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:00 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:29.756 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:47:29.787 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 762 k 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 762 k 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 769 k 2024-04-15T14:47:29.788 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:47:29.809 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:29.810 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:47:29.810 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:29.876 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-dashboard 2024-04-15T14:47:30.217 INFO:teuthology.orchestra.run.smithi038.stdout:cephadm-19.0.0-3080.gc2d8c315.el9.noarch.rpm 1.7 MB/s | 762 kB 00:00 2024-04-15T14:47:30.218 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:30.218 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.7 MB/s | 762 kB 00:00 2024-04-15T14:47:30.218 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:47:30.223 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:47:30.223 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:47:30.229 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:47:30.230 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:47:30.305 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:47:30.451 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:01 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:30.603 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:30.604 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================== 2024-04-15T14:47:30.604 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:47:30.604 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================== 2024-04-15T14:47:30.604 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:47:30.604 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 3.5 M 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 34 k 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 16 k 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:30.605 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:47:30.606 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================== 2024-04-15T14:47:30.606 INFO:teuthology.orchestra.run.smithi164.stdout:Install 12 Packages 2024-04-15T14:47:30.606 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:30.606 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 8.6 M 2024-04-15T14:47:30.606 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 104 M 2024-04-15T14:47:30.606 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:47:30.763 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/1 2024-04-15T14:47:30.857 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/1 2024-04-15T14:47:30.952 INFO:teuthology.orchestra.run.smithi164.stdout:(1/12): ceph-prometheus-alerts-19.0.0-3080.gc2d 86 kB/s | 16 kB 00:00 2024-04-15T14:47:31.002 INFO:teuthology.orchestra.run.smithi164.stdout:(2/12): ceph-grafana-dashboards-19.0.0-3080.gc2 141 kB/s | 34 kB 00:00 2024-04-15T14:47:31.077 INFO:teuthology.orchestra.run.smithi164.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 3.1 MB/s | 238 kB 00:00 2024-04-15T14:47:31.127 INFO:teuthology.orchestra.run.smithi164.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.7 MB/s | 1.0 MB 00:00 2024-04-15T14:47:31.232 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/1 2024-04-15T14:47:31.320 INFO:teuthology.orchestra.run.smithi164.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.5 MB/s | 863 kB 00:00 2024-04-15T14:47:31.403 INFO:teuthology.orchestra.run.smithi164.stdout:(6/12): ceph-mgr-dashboard-19.0.0-3080.gc2d8c31 5.5 MB/s | 3.5 MB 00:00 2024-04-15T14:47:31.540 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/1 2024-04-15T14:47:31.540 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:31.540 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:47:31.540 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:31.540 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:31.540 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:47:31.612 INFO:teuthology.orchestra.run.smithi164.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.1 MB/s | 548 kB 00:00 2024-04-15T14:47:31.629 INFO:teuthology.orchestra.run.smithi164.stdout:(8/12): grpc-data-1.46.7-10.el9.noarch.rpm 63 kB/s | 19 kB 00:00 2024-04-15T14:47:31.695 INFO:teuthology.orchestra.run.smithi164.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.7 MB/s | 144 kB 00:00 2024-04-15T14:47:31.722 INFO:teuthology.orchestra.run.smithi164.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 334 kB/s | 31 kB 00:00 2024-04-15T14:47:31.725 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-immutable-object-cache 2024-04-15T14:47:31.779 INFO:teuthology.orchestra.run.smithi164.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-04-15T14:47:31.996 INFO:teuthology.orchestra.run.smithi164.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.6 MB/s | 2.0 MB 00:00 2024-04-15T14:47:32.001 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:32.001 INFO:teuthology.orchestra.run.smithi164.stdout:Total 6.2 MB/s | 8.6 MB 00:01 2024-04-15T14:47:32.020 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:47:32.038 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:47:32.038 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:47:32.209 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:47:32.209 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:47:32.315 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:00 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:47:32.477 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:47:32.478 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:47:32.478 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:47:32.478 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:47:32.478 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:47:32.478 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 145 k 2024-04-15T14:47:32.478 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:32.478 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:47:32.478 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:47:32.479 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:47:32.479 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:32.479 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 145 k 2024-04-15T14:47:32.479 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 435 k 2024-04-15T14:47:32.479 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:47:32.739 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:47:32.822 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-15T14:47:32.857 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-immutable-object-cache-19.0.0-3080.gc2d8c3 385 kB/s | 145 kB 00:00 2024-04-15T14:47:32.857 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:32.857 INFO:teuthology.orchestra.run.smithi038.stdout:Total 383 kB/s | 145 kB 00:00 2024-04-15T14:47:32.857 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:47:32.866 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-15T14:47:32.866 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:47:32.866 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:47:32.911 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-15T14:47:32.920 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:47:32.921 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:47:32.951 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-15T14:47:33.060 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-15T14:47:33.077 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:47:33.141 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3080.gc2d8c315. 1/1 2024-04-15T14:47:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3080.gc2d8c315. 1/1 2024-04-15T14:47:33.165 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:47:33.165 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T14:47:33.165 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:33.185 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-15T14:47:33.278 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-15T14:47:33.331 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-15T14:47:33.359 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-15T14:47:33.391 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3080.gc2d8c315.el9 10/12 2024-04-15T14:47:34.132 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3080.gc2d8c315. 1/1 2024-04-15T14:47:34.132 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:34.132 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:47:34.132 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:47:34.133 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:34.133 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:47:34.435 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3080.gc2d8c315.el 11/12 2024-04-15T14:47:34.475 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3080.gc2d8c315.el9.noa 12/12 2024-04-15T14:47:34.478 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr 2024-04-15T14:47:35.070 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:03 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:47:35.171 INFO:teuthology.orchestra.run.smithi038.stdout:Package ceph-mgr-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:47:35.226 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:47:35.228 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:47:35.228 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:47:35.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-dashboard 2024-04-15T14:47:35.587 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3080.gc2d8c315.el9.noa 12/12 2024-04-15T14:47:35.587 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3080.gc2d8c315.el 1/12 2024-04-15T14:47:35.587 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3080.gc2d8c315.el9.noa 2/12 2024-04-15T14:47:35.587 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3080.gc2d8c315.el9 3/12 2024-04-15T14:47:35.587 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-15T14:47:35.587 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-15T14:47:35.587 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-15T14:47:35.588 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-15T14:47:35.588 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-15T14:47:35.588 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-15T14:47:35.588 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-15T14:47:35.588 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-15T14:47:35.879 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:03 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:47:35.945 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-15T14:47:35.945 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:35.945 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:47:35.945 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-15T14:47:35.945 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:35.946 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:35.946 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:35.946 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-15T14:47:35.946 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-15T14:47:35.946 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-15T14:47:35.946 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-15T14:47:35.946 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-15T14:47:35.947 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-15T14:47:35.947 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T14:47:35.947 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T14:47:35.947 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:35.947 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:36.036 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:47:36.037 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================== 2024-04-15T14:47:36.037 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================== 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 3.5 M 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 34 k 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 16 k 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-15T14:47:36.038 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-15T14:47:36.039 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-15T14:47:36.039 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T14:47:36.039 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T14:47:36.039 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:36.039 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:47:36.039 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================== 2024-04-15T14:47:36.039 INFO:teuthology.orchestra.run.smithi038.stdout:Install 12 Packages 2024-04-15T14:47:36.039 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:36.040 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 8.6 M 2024-04-15T14:47:36.040 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 104 M 2024-04-15T14:47:36.040 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:47:36.188 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-15T14:47:36.752 INFO:teuthology.orchestra.run.smithi038.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3080.gc2 166 kB/s | 34 kB 00:00 2024-04-15T14:47:36.767 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:07 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:36.852 INFO:teuthology.orchestra.run.smithi038.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3080.gc2d 54 kB/s | 16 kB 00:00 2024-04-15T14:47:36.923 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:36.924 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-04-15T14:47:36.924 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 7.4 M 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-15T14:47:36.925 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T14:47:36.926 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-15T14:47:36.926 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-15T14:47:36.926 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-15T14:47:36.926 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:36.926 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:47:36.926 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-04-15T14:47:36.926 INFO:teuthology.orchestra.run.smithi164.stdout:Install 12 Packages 2024-04-15T14:47:36.926 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:36.927 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 37 M 2024-04-15T14:47:36.927 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 209 M 2024-04-15T14:47:36.927 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:47:37.002 INFO:teuthology.orchestra.run.smithi038.stdout:(3/12): ceph-mgr-dashboard-19.0.0-3080.gc2d8c31 7.8 MB/s | 3.5 MB 00:00 2024-04-15T14:47:37.044 INFO:teuthology.orchestra.run.smithi038.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-04-15T14:47:37.069 INFO:teuthology.orchestra.run.smithi038.stdout:(5/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 238 kB 00:00 2024-04-15T14:47:37.195 INFO:teuthology.orchestra.run.smithi038.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 156 kB/s | 19 kB 00:00 2024-04-15T14:47:37.195 INFO:teuthology.orchestra.run.smithi164.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 219 kB/s | 32 kB 00:00 2024-04-15T14:47:37.229 INFO:teuthology.orchestra.run.smithi164.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 523 kB/s | 17 kB 00:00 2024-04-15T14:47:37.271 INFO:teuthology.orchestra.run.smithi164.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 842 kB/s | 34 kB 00:00 2024-04-15T14:47:37.278 INFO:teuthology.orchestra.run.smithi038.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.1 MB/s | 863 kB 00:00 2024-04-15T14:47:37.338 INFO:teuthology.orchestra.run.smithi164.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-04-15T14:47:37.345 INFO:teuthology.orchestra.run.smithi038.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.8 MB/s | 548 kB 00:00 2024-04-15T14:47:37.395 INFO:teuthology.orchestra.run.smithi038.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 615 kB/s | 31 kB 00:00 2024-04-15T14:47:37.454 INFO:teuthology.orchestra.run.smithi038.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.2 MB/s | 188 kB 00:00 2024-04-15T14:47:37.479 INFO:teuthology.orchestra.run.smithi038.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 720 kB/s | 144 kB 00:00 2024-04-15T14:47:37.530 INFO:teuthology.orchestra.run.smithi038.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.1 MB/s | 2.0 MB 00:00 2024-04-15T14:47:37.530 INFO:teuthology.orchestra.run.smithi164.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2024-04-15T14:47:37.533 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:37.533 INFO:teuthology.orchestra.run.smithi038.stdout:Total 5.8 MB/s | 8.6 MB 00:01 2024-04-15T14:47:37.552 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:47:37.572 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:47:37.572 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:47:37.597 INFO:teuthology.orchestra.run.smithi164.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2024-04-15T14:47:37.631 INFO:teuthology.orchestra.run.smithi164.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 217 kB 00:00 2024-04-15T14:47:37.739 INFO:teuthology.orchestra.run.smithi164.stdout:(8/12): ceph-mgr-diskprediction-local-19.0.0-30 11 MB/s | 7.4 MB 00:00 2024-04-15T14:47:37.777 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:47:37.777 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:47:37.998 INFO:teuthology.orchestra.run.smithi164.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-04-15T14:47:38.023 INFO:teuthology.orchestra.run.smithi164.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 694 kB/s | 195 kB 00:00 2024-04-15T14:47:38.140 INFO:teuthology.orchestra.run.smithi164.stdout:(11/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 803 kB 00:00 2024-04-15T14:47:38.257 INFO:teuthology.orchestra.run.smithi164.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 950 kB/s | 245 kB 00:00 2024-04-15T14:47:38.259 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:38.260 INFO:teuthology.orchestra.run.smithi164.stdout:Total 28 MB/s | 37 MB 00:01 2024-04-15T14:47:38.301 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:47:38.325 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:47:38.325 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:47:38.448 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:47:38.522 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-15T14:47:38.557 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-15T14:47:38.604 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-15T14:47:38.642 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-15T14:47:38.675 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:47:38.676 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:47:38.752 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-15T14:47:38.889 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-15T14:47:38.982 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-15T14:47:39.031 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-15T14:47:39.059 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-15T14:47:39.092 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3080.gc2d8c315.el9 10/12 2024-04-15T14:47:39.375 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:47:39.446 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-15T14:47:39.486 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-15T14:47:39.580 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-15T14:47:39.631 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-15T14:47:39.809 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-15T14:47:39.838 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-15T14:47:39.927 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-15T14:47:40.189 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3080.gc2d8c315.el 11/12 2024-04-15T14:47:40.224 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3080.gc2d8c315.el9.noa 12/12 2024-04-15T14:47:40.572 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-15T14:47:40.675 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3080.gc2d8c315.el9.noa 12/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3080.gc2d8c315.el 1/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3080.gc2d8c315.el9.noa 2/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3080.gc2d8c315.el9 3/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-15T14:47:41.643 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-15T14:47:41.644 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-15T14:47:41.644 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-15T14:47:41.939 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-15T14:47:41.999 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-15T14:47:41.999 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:41.999 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:47:41.999 INFO:teuthology.orchestra.run.smithi038.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:42.000 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:47:42.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-15T14:47:42.831 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:10 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:47:42.969 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-15T14:47:42.994 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:47:42.995 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================================ 2024-04-15T14:47:42.995 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:47:42.995 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================================ 2024-04-15T14:47:42.995 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:47:42.995 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 7.4 M 2024-04-15T14:47:42.995 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:47:42.995 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-15T14:47:42.996 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:42.997 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:47:42.997 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================================ 2024-04-15T14:47:42.997 INFO:teuthology.orchestra.run.smithi038.stdout:Install 12 Packages 2024-04-15T14:47:42.997 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:42.997 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3080.gc2d8c 12/12 2024-04-15T14:47:42.998 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 37 M 2024-04-15T14:47:42.998 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 209 M 2024-04-15T14:47:42.998 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:47:43.479 INFO:teuthology.orchestra.run.smithi038.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 233 kB/s | 32 kB 00:00 2024-04-15T14:47:43.504 INFO:teuthology.orchestra.run.smithi038.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 727 kB/s | 17 kB 00:00 2024-04-15T14:47:43.538 INFO:teuthology.orchestra.run.smithi038.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-04-15T14:47:43.588 INFO:teuthology.orchestra.run.smithi038.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-04-15T14:47:43.881 INFO:teuthology.orchestra.run.smithi038.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2024-04-15T14:47:43.947 INFO:teuthology.orchestra.run.smithi038.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 4.8 MB 00:00 2024-04-15T14:47:43.972 INFO:teuthology.orchestra.run.smithi038.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-04-15T14:47:44.398 INFO:teuthology.orchestra.run.smithi038.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 803 kB 00:00 2024-04-15T14:47:44.615 INFO:teuthology.orchestra.run.smithi038.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-04-15T14:47:44.640 INFO:teuthology.orchestra.run.smithi038.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 813 kB/s | 195 kB 00:00 2024-04-15T14:47:44.923 INFO:teuthology.orchestra.run.smithi038.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 796 kB/s | 245 kB 00:00 2024-04-15T14:47:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3080.gc2d8c 12/12 2024-04-15T14:47:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3080.gc2d8c 1/12 2024-04-15T14:47:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-15T14:47:45.518 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-15T14:47:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-15T14:47:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-15T14:47:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-15T14:47:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-15T14:47:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-15T14:47:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-15T14:47:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-15T14:47:45.519 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-15T14:47:45.919 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T14:47:45.920 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T14:47:45.921 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T14:47:45.921 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:45.921 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:46.293 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-rook 2024-04-15T14:47:46.886 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:17 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:47.042 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================== 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================== 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 49 k 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T14:47:47.044 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================== 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout:Install 13 Packages 2024-04-15T14:47:47.045 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:47.046 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 2.0 M 2024-04-15T14:47:47.046 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 26 M 2024-04-15T14:47:47.046 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:47:47.531 INFO:teuthology.orchestra.run.smithi164.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 142 kB/s | 18 kB 00:00 2024-04-15T14:47:47.556 INFO:teuthology.orchestra.run.smithi164.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 160 kB/s | 24 kB 00:00 2024-04-15T14:47:47.582 INFO:teuthology.orchestra.run.smithi038.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-3 1.7 MB/s | 7.4 MB 00:04 2024-04-15T14:47:47.584 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:47.584 INFO:teuthology.orchestra.run.smithi038.stdout:Total 8.1 MB/s | 37 MB 00:04 2024-04-15T14:47:47.607 INFO:teuthology.orchestra.run.smithi164.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-04-15T14:47:47.629 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:47:47.632 INFO:teuthology.orchestra.run.smithi164.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-15T14:47:47.656 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:47:47.656 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:47:47.657 INFO:teuthology.orchestra.run.smithi164.stdout:(5/13): ceph-mgr-rook-19.0.0-3080.gc2d8c315.el9 194 kB/s | 49 kB 00:00 2024-04-15T14:47:47.682 INFO:teuthology.orchestra.run.smithi164.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 211 kB 00:00 2024-04-15T14:47:47.699 INFO:teuthology.orchestra.run.smithi164.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 641 kB/s | 43 kB 00:00 2024-04-15T14:47:47.908 INFO:teuthology.orchestra.run.smithi164.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 143 kB/s | 32 kB 00:00 2024-04-15T14:47:47.933 INFO:teuthology.orchestra.run.smithi164.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2024-04-15T14:47:48.025 INFO:teuthology.orchestra.run.smithi164.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 622 kB/s | 203 kB 00:00 2024-04-15T14:47:48.038 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:47:48.038 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:47:48.109 INFO:teuthology.orchestra.run.smithi164.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-04-15T14:47:48.134 INFO:teuthology.orchestra.run.smithi164.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 295 kB/s | 59 kB 00:00 2024-04-15T14:47:48.159 INFO:teuthology.orchestra.run.smithi164.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 672 kB/s | 90 kB 00:00 2024-04-15T14:47:48.164 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:48.164 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-04-15T14:47:48.164 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:47:48.177 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:47:48.177 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:47:48.269 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:47:48.269 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:47:48.773 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:47:48.781 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:47:48.838 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-15T14:47:48.869 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-15T14:47:48.956 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-15T14:47:48.969 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-15T14:47:49.006 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-15T14:47:49.010 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-15T14:47:49.065 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-15T14:47:49.103 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-15T14:47:49.144 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-15T14:47:49.191 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-15T14:47:49.222 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-15T14:47:49.237 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-15T14:47:49.310 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-15T14:47:49.345 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-15T14:47:49.396 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-15T14:47:49.999 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-15T14:47:50.113 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-15T14:47:50.119 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-15T14:47:50.168 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-15T14:47:50.202 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-15T14:47:50.250 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-15T14:47:50.272 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.0.0-3080.gc2d8c315.el9.noarch 13/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3080.gc2d8c315.el9.noarch 13/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3080.gc2d8c315.el9.noarch 1/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-15T14:47:51.139 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-15T14:47:51.140 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-15T14:47:51.414 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-15T14:47:51.500 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T14:47:51.501 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T14:47:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T14:47:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T14:47:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T14:47:51.502 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:51.502 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:51.761 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-cephadm 2024-04-15T14:47:52.342 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:23 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:52.496 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:52.496 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================== 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================== 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 142 k 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:52.497 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:47:52.498 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================== 2024-04-15T14:47:52.498 INFO:teuthology.orchestra.run.smithi164.stdout:Install 6 Packages 2024-04-15T14:47:52.498 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:52.498 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 6.8 M 2024-04-15T14:47:52.498 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 33 M 2024-04-15T14:47:52.498 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:47:52.501 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-15T14:47:52.529 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3080.gc2d8c 12/12 2024-04-15T14:47:52.995 INFO:teuthology.orchestra.run.smithi164.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-04-15T14:47:53.129 INFO:teuthology.orchestra.run.smithi164.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3080.gc2d8c315.e 507 kB/s | 142 kB 00:00 2024-04-15T14:47:53.254 INFO:teuthology.orchestra.run.smithi164.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2024-04-15T14:47:53.421 INFO:teuthology.orchestra.run.smithi164.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 306 kB/s | 51 kB 00:00 2024-04-15T14:47:53.471 INFO:teuthology.orchestra.run.smithi164.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 170 kB/s | 58 kB 00:00 2024-04-15T14:47:53.554 INFO:teuthology.orchestra.run.smithi164.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 981 kB/s | 548 kB 00:00 2024-04-15T14:47:53.556 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:53.557 INFO:teuthology.orchestra.run.smithi164.stdout:Total 6.4 MB/s | 6.8 MB 00:01 2024-04-15T14:47:53.570 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:47:53.581 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:47:53.581 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:47:53.670 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:47:53.671 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:47:53.978 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:47:54.145 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-15T14:47:54.198 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-15T14:47:54.722 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-15T14:47:54.801 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-15T14:47:54.865 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-15T14:47:54.902 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 6/6 2024-04-15T14:47:55.275 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3080.gc2d8c 12/12 2024-04-15T14:47:55.275 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3080.gc2d8c 1/12 2024-04-15T14:47:55.275 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-15T14:47:55.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-15T14:47:55.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-15T14:47:55.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-15T14:47:55.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-15T14:47:55.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-15T14:47:55.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-15T14:47:55.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-15T14:47:55.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-15T14:47:55.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T14:47:55.684 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T14:47:55.685 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T14:47:55.685 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T14:47:55.685 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T14:47:55.685 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:55.685 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:47:55.692 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 6/6 2024-04-15T14:47:55.692 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/6 2024-04-15T14:47:55.692 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-15T14:47:55.692 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-15T14:47:55.692 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-15T14:47:55.692 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-15T14:47:55.991 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-15T14:47:55.991 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:55.992 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:47:55.992 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:47:55.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T14:47:55.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T14:47:55.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T14:47:55.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T14:47:55.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T14:47:55.992 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:55.992 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:56.095 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-rook 2024-04-15T14:47:56.219 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-fuse 2024-04-15T14:47:56.685 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:24 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:47:56.800 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:27 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:56.847 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:47:56.848 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2024-04-15T14:47:56.848 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:47:56.848 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2024-04-15T14:47:56.848 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:47:56.848 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 49 k 2024-04-15T14:47:56.848 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:47:56.848 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:47:56.849 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2024-04-15T14:47:56.850 INFO:teuthology.orchestra.run.smithi038.stdout:Install 13 Packages 2024-04-15T14:47:56.850 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:47:56.850 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 2.0 M 2024-04-15T14:47:56.850 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 26 M 2024-04-15T14:47:56.850 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:47:56.954 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 890 k 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout:Install 2 Packages 2024-04-15T14:47:56.955 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:56.956 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 968 k 2024-04-15T14:47:56.956 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 2.8 M 2024-04-15T14:47:56.956 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:47:57.073 INFO:teuthology.orchestra.run.smithi164.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 673 kB/s | 79 kB 00:00 2024-04-15T14:47:57.079 INFO:teuthology.orchestra.run.smithi038.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 172 kB/s | 24 kB 00:00 2024-04-15T14:47:57.104 INFO:teuthology.orchestra.run.smithi038.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 108 kB/s | 18 kB 00:00 2024-04-15T14:47:57.154 INFO:teuthology.orchestra.run.smithi038.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-04-15T14:47:57.179 INFO:teuthology.orchestra.run.smithi038.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-15T14:47:57.205 INFO:teuthology.orchestra.run.smithi038.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-04-15T14:47:57.230 INFO:teuthology.orchestra.run.smithi038.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 855 kB/s | 43 kB 00:00 2024-04-15T14:47:57.248 INFO:teuthology.orchestra.run.smithi164.stdout:(2/2): ceph-fuse-19.0.0-3080.gc2d8c315.el9.x86_ 3.0 MB/s | 890 kB 00:00 2024-04-15T14:47:57.249 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:57.250 INFO:teuthology.orchestra.run.smithi164.stdout:Total 3.2 MB/s | 968 kB 00:00 2024-04-15T14:47:57.250 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:47:57.255 INFO:teuthology.orchestra.run.smithi038.stdout:(7/13): ceph-mgr-rook-19.0.0-3080.gc2d8c315.el9 154 kB/s | 49 kB 00:00 2024-04-15T14:47:57.271 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:47:57.271 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:47:57.345 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:47:57.346 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:47:57.480 INFO:teuthology.orchestra.run.smithi038.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2024-04-15T14:47:57.506 INFO:teuthology.orchestra.run.smithi038.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 107 kB/s | 32 kB 00:00 2024-04-15T14:47:57.527 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:47:57.670 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-15T14:47:57.723 INFO:teuthology.orchestra.run.smithi038.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 273 kB/s | 59 kB 00:00 2024-04-15T14:47:57.732 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/2 2024-04-15T14:47:57.749 INFO:teuthology.orchestra.run.smithi038.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 411 kB/s | 203 kB 00:00 2024-04-15T14:47:57.898 INFO:teuthology.orchestra.run.smithi038.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 512 kB/s | 90 kB 00:00 2024-04-15T14:47:58.015 INFO:teuthology.orchestra.run.smithi038.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.9 MB/s | 1.0 MB 00:00 2024-04-15T14:47:58.017 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:47:58.018 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-04-15T14:47:58.018 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:47:58.034 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:47:58.034 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:47:58.138 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:47:58.139 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:47:58.389 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/2 2024-04-15T14:47:58.390 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/2 2024-04-15T14:47:58.657 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:47:58.707 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-15T14:47:58.707 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:58.707 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:47:58.707 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-15T14:47:58.707 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:58.707 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:47:58.827 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-15T14:47:58.885 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-15T14:47:58.940 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-15T14:47:58.976 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-15T14:47:59.012 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-volume 2024-04-15T14:47:59.018 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-15T14:47:59.114 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-15T14:47:59.224 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-15T14:47:59.278 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-15T14:47:59.610 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:30 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:47:59.760 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:47:59.761 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:59.761 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-15T14:47:59.761 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:59.761 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:47:59.761 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 264 k 2024-04-15T14:47:59.761 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:47:59.762 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-15T14:47:59.762 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:59.762 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:47:59.762 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:47:59.762 INFO:teuthology.orchestra.run.smithi164.stdout:Install 2 Packages 2024-04-15T14:47:59.762 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:47:59.762 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 332 k 2024-04-15T14:47:59.762 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 1.5 M 2024-04-15T14:47:59.762 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:47:59.938 INFO:teuthology.orchestra.run.smithi164.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 390 kB/s | 69 kB 00:00 2024-04-15T14:48:00.050 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-15T14:48:00.099 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-15T14:48:00.133 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-15T14:48:00.180 INFO:teuthology.orchestra.run.smithi164.stdout:(2/2): ceph-volume-19.0.0-3080.gc2d8c315.el9.no 631 kB/s | 264 kB 00:00 2024-04-15T14:48:00.181 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:00.182 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-15T14:48:00.182 INFO:teuthology.orchestra.run.smithi164.stdout:Total 791 kB/s | 332 kB 00:00 2024-04-15T14:48:00.182 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:48:00.190 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:48:00.190 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:48:00.211 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:19.0.0-3080.gc2d8c315.el9.noarch 13/13 2024-04-15T14:48:00.236 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:48:00.236 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:48:00.393 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:48:00.574 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-15T14:48:00.616 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.0.0-3080.gc2d8c315.el9.noarch 2/2 2024-04-15T14:48:00.634 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.0.0-3080.gc2d8c315.el9.noarch 2/2 2024-04-15T14:48:00.635 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:48:00.635 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-15T14:48:00.635 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:01.012 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3080.gc2d8c315.el9.noarch 13/13 2024-04-15T14:48:01.012 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3080.gc2d8c315.el9.noarch 1/13 2024-04-15T14:48:01.012 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-15T14:48:01.012 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-15T14:48:01.012 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-15T14:48:01.013 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-15T14:48:01.013 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-15T14:48:01.013 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-15T14:48:01.013 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-15T14:48:01.013 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-15T14:48:01.013 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-15T14:48:01.013 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-15T14:48:01.013 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-15T14:48:01.356 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.0.0-3080.gc2d8c315.el9.noarch 1/2 2024-04-15T14:48:01.390 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-15T14:48:01.390 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:01.390 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:48:01.390 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:48:01.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T14:48:01.390 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:01.391 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:01.634 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-cephadm 2024-04-15T14:48:01.680 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-15T14:48:01.681 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:01.681 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:48:01.681 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:48:01.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-15T14:48:01.681 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:01.681 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:02.029 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados-devel 2024-04-15T14:48:02.217 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:30 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:02.375 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:02.376 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2024-04-15T14:48:02.376 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:48:02.376 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2024-04-15T14:48:02.376 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:48:02.376 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 142 k 2024-04-15T14:48:02.376 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout:Install 6 Packages 2024-04-15T14:48:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:02.378 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 6.8 M 2024-04-15T14:48:02.378 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 33 M 2024-04-15T14:48:02.378 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:48:02.622 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:33 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:02.774 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:02.775 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:02.775 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:48:02.775 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:02.775 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:48:02.775 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 127 k 2024-04-15T14:48:02.775 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:02.775 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:48:02.775 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:02.775 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:48:02.776 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:02.776 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 127 k 2024-04-15T14:48:02.776 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 456 k 2024-04-15T14:48:02.776 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:48:02.978 INFO:teuthology.orchestra.run.smithi164.stdout:librados-devel-19.0.0-3080.gc2d8c315.el9.x86_64 627 kB/s | 127 kB 00:00 2024-04-15T14:48:02.979 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:02.979 INFO:teuthology.orchestra.run.smithi164.stdout:Total 622 kB/s | 127 kB 00:00 2024-04-15T14:48:02.979 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:48:02.984 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:48:02.985 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:48:03.040 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:48:03.040 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:48:03.190 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:48:03.236 INFO:teuthology.orchestra.run.smithi038.stdout:(1/6): ceph-mgr-cephadm-19.0.0-3080.gc2d8c315.e 623 kB/s | 142 kB 00:00 2024-04-15T14:48:03.285 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:03.627 INFO:teuthology.orchestra.run.smithi038.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.3 MB/s | 5.8 MB 00:00 2024-04-15T14:48:03.692 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:03.761 INFO:teuthology.orchestra.run.smithi038.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 329 kB/s | 248 kB 00:00 2024-04-15T14:48:03.878 INFO:teuthology.orchestra.run.smithi038.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 854 kB/s | 548 kB 00:00 2024-04-15T14:48:03.998 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:03.998 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:03.998 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:48:03.998 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:03.998 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:03.998 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:04.003 INFO:teuthology.orchestra.run.smithi038.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 154 kB/s | 58 kB 00:00 2024-04-15T14:48:04.219 INFO:teuthology.orchestra.run.smithi038.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 111 kB/s | 51 kB 00:00 2024-04-15T14:48:04.223 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:04.223 INFO:teuthology.orchestra.run.smithi038.stdout:Total 3.7 MB/s | 6.8 MB 00:01 2024-04-15T14:48:04.237 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:48:04.249 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:48:04.249 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:48:04.260 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs2 2024-04-15T14:48:04.344 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:48:04.344 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:48:04.656 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:48:04.825 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-15T14:48:04.853 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:35 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:04.880 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-15T14:48:04.954 INFO:teuthology.orchestra.run.smithi164.stdout:Package libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:05.008 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:05.009 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:48:05.010 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:05.072 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs-devel 2024-04-15T14:48:05.427 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-15T14:48:05.518 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-15T14:48:05.580 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-15T14:48:05.608 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 6/6 2024-04-15T14:48:05.656 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:36 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:05.809 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:05.810 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 32 k 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:05.811 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 32 k 2024-04-15T14:48:05.812 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 142 k 2024-04-15T14:48:05.812 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:48:06.099 INFO:teuthology.orchestra.run.smithi164.stdout:libcephfs-devel-19.0.0-3080.gc2d8c315.el9.x86_6 110 kB/s | 32 kB 00:00 2024-04-15T14:48:06.100 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:06.100 INFO:teuthology.orchestra.run.smithi164.stdout:Total 110 kB/s | 32 kB 00:00 2024-04-15T14:48:06.100 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:48:06.103 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:48:06.103 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:48:06.137 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:48:06.137 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:48:06.268 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:48:06.380 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:06.514 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 6/6 2024-04-15T14:48:06.515 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 1/6 2024-04-15T14:48:06.515 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-15T14:48:06.515 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-15T14:48:06.515 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-15T14:48:06.515 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-15T14:48:06.760 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:06.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-15T14:48:06.829 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:06.830 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:48:06.830 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:48:06.830 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T14:48:06.830 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T14:48:06.830 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T14:48:06.830 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T14:48:06.830 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T14:48:06.830 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:06.830 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:07.038 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:07.039 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:07.039 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:48:07.039 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:07.039 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:07.039 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:07.185 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-fuse 2024-04-15T14:48:07.216 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados2 2024-04-15T14:48:07.773 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:35 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:07.796 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:38 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:07.896 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:07.935 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:07.936 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:07.936 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:48:07.936 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:07.936 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:48:07.936 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 890 k 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout:Install 2 Packages 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 968 k 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 2.8 M 2024-04-15T14:48:07.937 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:48:07.948 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:07.949 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:48:07.949 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:08.002 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librbd1 2024-04-15T14:48:08.229 INFO:teuthology.orchestra.run.smithi038.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 269 kB/s | 79 kB 00:00 2024-04-15T14:48:08.581 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:39 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:08.613 INFO:teuthology.orchestra.run.smithi038.stdout:(2/2): ceph-fuse-19.0.0-3080.gc2d8c315.el9.x86_ 1.3 MB/s | 890 kB 00:00 2024-04-15T14:48:08.614 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:08.614 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.4 MB/s | 968 kB 00:00 2024-04-15T14:48:08.615 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:48:08.637 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:48:08.637 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:48:08.679 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:08.714 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:48:08.715 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:48:08.732 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:08.733 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:48:08.733 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:08.781 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rados 2024-04-15T14:48:08.892 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:48:09.029 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-15T14:48:09.107 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/2 2024-04-15T14:48:09.363 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:40 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:09.462 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rados-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:09.513 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:09.514 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:48:09.514 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:09.566 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rgw 2024-04-15T14:48:09.791 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/2 2024-04-15T14:48:09.791 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/2 2024-04-15T14:48:10.095 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-15T14:48:10.095 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:10.095 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:48:10.095 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-15T14:48:10.095 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:10.095 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:10.144 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:41 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:10.242 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:10.296 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:10.297 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:48:10.298 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:10.358 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-cephfs 2024-04-15T14:48:10.359 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-volume 2024-04-15T14:48:10.939 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:41 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:10.957 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:38 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:11.041 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-cephfs-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:11.094 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:11.095 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:48:11.095 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:11.119 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume noarch 2:19.0.0-3080.gc2d8c315.el9 ceph-noarch 264 k 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:11.120 INFO:teuthology.orchestra.run.smithi038.stdout:Install 2 Packages 2024-04-15T14:48:11.121 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:11.121 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 332 k 2024-04-15T14:48:11.121 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 1.5 M 2024-04-15T14:48:11.121 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:48:11.138 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rbd 2024-04-15T14:48:11.284 INFO:teuthology.orchestra.run.smithi038.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 423 kB/s | 69 kB 00:00 2024-04-15T14:48:11.684 INFO:teuthology.orchestra.run.smithi038.stdout:(2/2): ceph-volume-19.0.0-3080.gc2d8c315.el9.no 469 kB/s | 264 kB 00:00 2024-04-15T14:48:11.685 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:11.686 INFO:teuthology.orchestra.run.smithi038.stdout:Total 588 kB/s | 332 kB 00:00 2024-04-15T14:48:11.686 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:48:11.695 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:48:11.696 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:48:11.721 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:42 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:48:11.739 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:48:11.820 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:11.872 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:11.873 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:48:11.873 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:11.896 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:48:11.928 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-fuse 2024-04-15T14:48:12.073 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-15T14:48:12.103 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-volume-2:19.0.0-3080.gc2d8c315.el9.noarch 2/2 2024-04-15T14:48:12.120 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-volume-2:19.0.0-3080.gc2d8c315.el9.noarch 2/2 2024-04-15T14:48:12.120 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:48:12.120 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-15T14:48:12.120 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:12.505 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:43 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:12.657 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:12.658 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:12.658 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 85 k 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 85 k 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 231 k 2024-04-15T14:48:12.659 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:48:12.893 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-fuse-19.0.0-3080.gc2d8c315.el9.x86_64.rpm 364 kB/s | 85 kB 00:00 2024-04-15T14:48:12.894 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:12.894 INFO:teuthology.orchestra.run.smithi164.stdout:Total 362 kB/s | 85 kB 00:00 2024-04-15T14:48:12.894 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:48:12.901 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:48:12.901 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:48:12.930 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-volume-2:19.0.0-3080.gc2d8c315.el9.noarch 1/2 2024-04-15T14:48:12.957 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:48:12.957 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:48:13.091 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:48:13.191 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:13.278 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-15T14:48:13.278 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:13.278 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:48:13.278 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume-2:19.0.0-3080.gc2d8c315.el9.noarch 2024-04-15T14:48:13.278 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-15T14:48:13.278 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:13.278 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:13.582 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:13.617 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados-devel 2024-04-15T14:48:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:13.879 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:48:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:13.879 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:13.879 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:14.153 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-mirror 2024-04-15T14:48:14.223 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:42 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:14.381 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:14.382 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:14.382 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:48:14.382 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:14.382 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:48:14.382 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 127 k 2024-04-15T14:48:14.382 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:14.382 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:48:14.382 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:14.382 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:48:14.383 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:14.383 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 127 k 2024-04-15T14:48:14.383 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 456 k 2024-04-15T14:48:14.383 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:48:14.777 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:45 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:14.934 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 3.1 M 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 3.1 M 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 13 M 2024-04-15T14:48:14.935 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:48:14.958 INFO:teuthology.orchestra.run.smithi038.stdout:librados-devel-19.0.0-3080.gc2d8c315.el9.x86_64 220 kB/s | 127 kB 00:00 2024-04-15T14:48:14.958 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:14.959 INFO:teuthology.orchestra.run.smithi038.stdout:Total 220 kB/s | 127 kB 00:00 2024-04-15T14:48:14.959 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:48:14.965 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:48:14.965 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:48:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:48:15.024 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:48:15.175 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:48:15.277 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:15.741 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:16.027 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:16.028 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:48:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:16.028 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:16.028 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:16.259 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs2 2024-04-15T14:48:16.851 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:44 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:16.953 INFO:teuthology.orchestra.run.smithi038.stdout:Package libcephfs2-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:17.009 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:17.011 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:48:17.011 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:17.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs-devel 2024-04-15T14:48:17.658 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:45 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:17.818 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:17.819 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 32 k 2024-04-15T14:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 32 k 2024-04-15T14:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 142 k 2024-04-15T14:48:17.820 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:48:18.220 INFO:teuthology.orchestra.run.smithi038.stdout:libcephfs-devel-19.0.0-3080.gc2d8c315.el9.x86_6 79 kB/s | 32 kB 00:00 2024-04-15T14:48:18.220 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:18.220 INFO:teuthology.orchestra.run.smithi038.stdout:Total 79 kB/s | 32 kB 00:00 2024-04-15T14:48:18.221 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:48:18.224 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:48:18.224 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:48:18.253 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:48:18.253 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:48:18.372 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:48:18.422 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-mirror-19.0.0-3080.gc2d8c315.el9.x86_64.rpm 907 kB/s | 3.1 MB 00:03 2024-04-15T14:48:18.423 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:18.423 INFO:teuthology.orchestra.run.smithi164.stdout:Total 907 kB/s | 3.1 MB 00:03 2024-04-15T14:48:18.424 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:48:18.435 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:48:18.435 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:48:18.470 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:18.512 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:48:18.512 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:48:18.885 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:18.937 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:48:18.998 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:19.024 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:19.024 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:48:19.024 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T14:48:19.024 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T14:48:19.024 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T14:48:19.024 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:19.160 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:19.160 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:19.160 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:48:19.160 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:19.160 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:19.160 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:19.317 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados2 2024-04-15T14:48:19.906 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:47 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:20.010 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:20.066 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:20.066 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:48:20.067 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:20.116 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librbd1 2024-04-15T14:48:20.145 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:20.145 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:20.145 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:48:20.145 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:20.145 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:20.146 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:20.391 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-nbd 2024-04-15T14:48:20.703 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:48 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:20.807 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:20.862 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:20.863 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:48:20.863 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:20.910 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rados 2024-04-15T14:48:20.990 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:51 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:21.144 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:21.144 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 170 k 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 170 k 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 494 k 2024-04-15T14:48:21.145 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:48:21.493 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-nbd-19.0.0-3080.gc2d8c315.el9.x86_64.rpm 491 kB/s | 170 kB 00:00 2024-04-15T14:48:21.493 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:21.493 INFO:teuthology.orchestra.run.smithi164.stdout:Total 489 kB/s | 170 kB 00:00 2024-04-15T14:48:21.494 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:48:21.499 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:49 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:21.501 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:48:21.502 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:48:21.558 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:48:21.558 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:48:21.601 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rados-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:21.656 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:21.657 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:48:21.657 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:21.706 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rgw 2024-04-15T14:48:21.711 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:48:21.816 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:22.232 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:22.297 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:50 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:22.399 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rgw-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:22.453 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:22.454 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:48:22.454 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:22.498 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-cephfs 2024-04-15T14:48:22.502 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:22.503 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:22.503 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:48:22.503 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:22.503 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:22.503 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:22.746 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-base-debuginfo 2024-04-15T14:48:23.090 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:51 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:23.194 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-cephfs-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:23.250 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:23.251 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:48:23.251 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:23.310 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rbd 2024-04-15T14:48:23.329 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:54 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:23.486 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 69 M 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 24 M 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout:Install 2 Packages 2024-04-15T14:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:23.488 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 93 M 2024-04-15T14:48:23.488 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 589 M 2024-04-15T14:48:23.488 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:48:23.905 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:51 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:24.006 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:48:24.060 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:48:24.061 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:24.106 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-fuse 2024-04-15T14:48:24.695 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:52 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:24.856 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:24.857 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:24.857 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-04-15T14:48:24.857 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:24.857 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:48:24.857 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 85 k 2024-04-15T14:48:24.857 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:24.857 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:48:24.858 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:24.858 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:48:24.858 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:24.858 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 85 k 2024-04-15T14:48:24.858 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 231 k 2024-04-15T14:48:24.858 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:48:25.173 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-fuse-19.0.0-3080.gc2d8c315.el9.x86_64.rpm 271 kB/s | 85 kB 00:00 2024-04-15T14:48:25.173 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:25.173 INFO:teuthology.orchestra.run.smithi038.stdout:Total 270 kB/s | 85 kB 00:00 2024-04-15T14:48:25.174 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:48:25.184 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:48:25.185 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:48:25.242 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:48:25.242 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:48:25.383 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:48:25.490 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:25.878 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:26.168 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:26.168 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:26.168 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:48:26.168 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:26.168 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:26.168 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:26.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-mirror 2024-04-15T14:48:26.713 INFO:teuthology.orchestra.run.smithi164.stdout:(1/2): ceph-debuginfo-19.0.0-3080.gc2d8c315.el9 7.5 MB/s | 24 MB 00:03 2024-04-15T14:48:26.988 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:54 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:27.144 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:27.145 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:27.145 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:48:27.145 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:27.145 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:48:27.145 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 3.1 M 2024-04-15T14:48:27.146 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:27.146 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:48:27.146 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:27.146 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:48:27.146 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:27.146 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 3.1 M 2024-04-15T14:48:27.146 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 13 M 2024-04-15T14:48:27.146 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:48:28.025 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-mirror-19.0.0-3080.gc2d8c315.el9.x86_64.rpm 3.5 MB/s | 3.1 MB 00:00 2024-04-15T14:48:28.025 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:28.026 INFO:teuthology.orchestra.run.smithi038.stdout:Total 3.5 MB/s | 3.1 MB 00:00 2024-04-15T14:48:28.026 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:48:28.037 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:48:28.037 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:48:28.116 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:48:28.116 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:48:28.480 INFO:teuthology.orchestra.run.smithi164.stdout:(2/2): ceph-base-debuginfo-19.0.0-3080.gc2d8c31 14 MB/s | 69 MB 00:04 2024-04-15T14:48:28.481 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:28.482 INFO:teuthology.orchestra.run.smithi164.stdout:Total 19 MB/s | 93 MB 00:04 2024-04-15T14:48:28.482 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:48:28.488 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:48:28.488 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:48:28.563 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:48:28.627 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:28.652 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:28.652 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T14:48:28.652 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T14:48:28.652 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T14:48:28.652 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T14:48:28.652 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:29.087 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:48:29.088 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:48:29.793 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:29.793 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:29.793 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:48:29.793 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:29.793 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:29.793 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:30.030 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-nbd 2024-04-15T14:48:30.623 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:58 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:30.781 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:30.782 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:30.782 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-04-15T14:48:30.782 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:30.782 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:48:30.782 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 170 k 2024-04-15T14:48:30.782 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:30.783 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:48:30.783 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:30.783 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:48:30.783 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:30.783 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 170 k 2024-04-15T14:48:30.783 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 494 k 2024-04-15T14:48:30.783 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:48:31.463 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-nbd-19.0.0-3080.gc2d8c315.el9.x86_64.rpm 251 kB/s | 170 kB 00:00 2024-04-15T14:48:31.463 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:31.464 INFO:teuthology.orchestra.run.smithi038.stdout:Total 250 kB/s | 170 kB 00:00 2024-04-15T14:48:31.464 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:48:31.473 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:48:31.473 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:48:31.534 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:48:31.535 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:48:31.700 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:48:31.816 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:32.266 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:32.543 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:48:32.543 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:32.543 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:48:32.543 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:32.543 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:32.544 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:48:32.774 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-base-debuginfo 2024-04-15T14:48:32.959 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:48:33.367 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:02:01 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:48:33.528 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:48:33.529 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:33.529 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:48:33.529 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:33.529 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:48:33.529 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 69 M 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 24 M 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout:Install 2 Packages 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 93 M 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 589 M 2024-04-15T14:48:33.530 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:48:36.132 INFO:teuthology.orchestra.run.smithi038.stdout:(1/2): ceph-debuginfo-19.0.0-3080.gc2d8c315.el9 9.3 MB/s | 24 MB 00:02 2024-04-15T14:48:40.171 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/2 2024-04-15T14:48:40.247 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 2/2 2024-04-15T14:48:44.185 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 2/2 2024-04-15T14:48:44.185 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/2 2024-04-15T14:48:44.456 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/2 2024-04-15T14:48:44.456 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:44.456 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:48:44.456 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:44.456 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:48:44.456 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:44.456 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:48:44.694 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-common-debuginfo 2024-04-15T14:48:45.304 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:02:16 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:48:45.462 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 454 M 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:48:45.463 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:48:45.464 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 454 M 2024-04-15T14:48:45.464 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 2.0 G 2024-04-15T14:48:45.464 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:48:48.748 INFO:teuthology.orchestra.run.smithi038.stdout:(2/2): ceph-base-debuginfo-19.0.0-3080.gc2d8c31 4.5 MB/s | 69 MB 00:15 2024-04-15T14:48:48.749 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:48:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:Total 6.1 MB/s | 93 MB 00:15 2024-04-15T14:48:48.750 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:48:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:48:48.755 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:48:49.379 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:48:49.380 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:48:53.446 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:49:01.032 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/2 2024-04-15T14:49:01.101 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 2/2 2024-04-15T14:49:05.119 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 2/2 2024-04-15T14:49:05.119 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/2 2024-04-15T14:49:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2/2 2024-04-15T14:49:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:49:05.397 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:49:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:49:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:49:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:49:05.398 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:49:05.608 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-common-debuginfo 2024-04-15T14:49:06.215 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:02:34 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:49:06.380 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:49:06.380 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:49:06.380 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 454 M 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 454 M 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 2.0 G 2024-04-15T14:49:06.381 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:49:19.789 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-common-debuginfo-19.0.0-3080.gc2d8c315.el9 13 MB/s | 454 MB 00:34 2024-04-15T14:49:19.790 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:49:19.790 INFO:teuthology.orchestra.run.smithi164.stdout:Total 13 MB/s | 454 MB 00:34 2024-04-15T14:49:19.791 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:49:19.796 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:49:19.796 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:49:22.492 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:49:22.492 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:49:39.875 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-common-debuginfo-19.0.0-3080.gc2d8c315.el9 14 MB/s | 454 MB 00:33 2024-04-15T14:49:39.876 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:49:39.876 INFO:teuthology.orchestra.run.smithi038.stdout:Total 14 MB/s | 454 MB 00:33 2024-04-15T14:49:39.876 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:49:39.881 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:49:39.881 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:49:42.702 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:49:42.702 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:50:09.514 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:50:09.617 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:50:18.970 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:50:19.243 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:50:19.243 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:50:19.243 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:50:19.243 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:50:19.243 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:50:19.243 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:50:19.483 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2024-04-15T14:50:20.070 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:03:51 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:50:20.223 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:50:20.224 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================== 2024-04-15T14:50:20.224 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:50:20.224 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================== 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 1.5 M 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================== 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 1.5 M 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 6.6 M 2024-04-15T14:50:20.225 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:50:20.937 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-immutable-object-cache-debuginfo-19.0.0-30 2.1 MB/s | 1.5 MB 00:00 2024-04-15T14:50:20.939 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:50:20.939 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.1 MB/s | 1.5 MB 00:00 2024-04-15T14:50:20.939 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:50:20.942 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:50:20.942 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:50:20.985 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:50:20.985 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:50:21.247 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:50:21.361 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-3080. 1/1 2024-04-15T14:50:21.776 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.0.0-3080. 1/1 2024-04-15T14:50:22.058 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-3080. 1/1 2024-04-15T14:50:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:50:22.059 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:50:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:50:22.059 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:50:22.059 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:50:22.248 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw-debuginfo 2024-04-15T14:50:22.832 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:03:53 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:50:22.986 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:50:22.987 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:50:22.987 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:50:22.987 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:50:22.987 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:50:22.988 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 190 M 2024-04-15T14:50:22.988 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:50:22.988 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:50:22.988 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:50:22.988 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:50:22.988 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:50:22.988 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 190 M 2024-04-15T14:50:22.988 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 964 M 2024-04-15T14:50:22.988 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:50:32.424 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:50:32.523 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:50:33.523 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-radosgw-debuginfo-19.0.0-3080.gc2d8c315.el 18 MB/s | 190 MB 00:10 2024-04-15T14:50:33.523 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:50:33.524 INFO:teuthology.orchestra.run.smithi164.stdout:Total 18 MB/s | 190 MB 00:10 2024-04-15T14:50:33.524 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:50:33.528 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:50:33.528 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:50:34.677 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:50:34.677 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:50:41.074 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:50:41.344 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:50:41.344 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:50:41.344 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:50:41.344 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:50:41.345 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:50:41.345 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:50:41.586 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2024-04-15T14:50:42.182 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:04:10 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:50:42.340 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:50:42.341 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2024-04-15T14:50:42.341 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:50:42.341 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2024-04-15T14:50:42.341 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:50:42.341 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 1.5 M 2024-04-15T14:50:42.342 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:50:42.342 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:50:42.342 INFO:teuthology.orchestra.run.smithi038.stdout:======================================================================================== 2024-04-15T14:50:42.342 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:50:42.342 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:50:42.342 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 1.5 M 2024-04-15T14:50:42.342 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 6.6 M 2024-04-15T14:50:42.342 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:50:43.049 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-immutable-object-cache-debuginfo-19.0.0-30 2.1 MB/s | 1.5 MB 00:00 2024-04-15T14:50:43.049 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:50:43.050 INFO:teuthology.orchestra.run.smithi038.stdout:Total 2.1 MB/s | 1.5 MB 00:00 2024-04-15T14:50:43.050 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:50:43.054 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:50:43.054 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:50:43.102 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:50:43.102 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:50:43.377 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:50:43.467 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-3080. 1/1 2024-04-15T14:50:43.858 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.0.0-3080. 1/1 2024-04-15T14:50:44.147 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-3080. 1/1 2024-04-15T14:50:44.147 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:50:44.147 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:50:44.147 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:50:44.147 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:50:44.147 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:50:44.323 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw-debuginfo 2024-04-15T14:50:44.918 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:04:12 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:50:45.081 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 190 M 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:50:45.082 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:50:45.083 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 190 M 2024-04-15T14:50:45.083 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 964 M 2024-04-15T14:50:45.083 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:50:54.801 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-radosgw-debuginfo-19.0.0-3080.gc2d8c315.el 20 MB/s | 190 MB 00:09 2024-04-15T14:50:54.803 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:50:54.803 INFO:teuthology.orchestra.run.smithi038.stdout:Total 20 MB/s | 190 MB 00:09 2024-04-15T14:50:54.803 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:50:54.807 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:50:54.807 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:50:55.394 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:50:55.552 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x 1/1 2024-04-15T14:50:56.004 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:50:56.004 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:51:01.366 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x 1/1 2024-04-15T14:51:01.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x 1/1 2024-04-15T14:51:01.627 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:51:01.627 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:51:01.627 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:51:01.627 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:51:01.628 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:51:01.840 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-test-debuginfo 2024-04-15T14:51:02.426 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:04:33 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:51:02.580 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:51:02.581 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:51:02.581 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:51:02.581 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:51:02.581 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:51:02.581 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 703 M 2024-04-15T14:51:02.582 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:51:02.582 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:51:02.582 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:51:02.582 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:51:02.582 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:51:02.582 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 703 M 2024-04-15T14:51:02.582 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 3.6 G 2024-04-15T14:51:02.582 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:51:17.698 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:51:17.801 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x 1/1 2024-04-15T14:51:23.728 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x 1/1 2024-04-15T14:51:23.994 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x 1/1 2024-04-15T14:51:23.994 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:51:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:51:23.994 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:51:23.994 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:51:23.994 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:51:24.210 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-test-debuginfo 2024-04-15T14:51:24.799 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:04:52 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:51:24.957 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:51:24.958 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:51:24.958 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:51:24.958 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:51:24.959 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:51:24.959 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 703 M 2024-04-15T14:51:24.959 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:51:24.959 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:51:24.959 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:51:24.959 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:51:24.960 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:51:24.960 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 703 M 2024-04-15T14:51:24.960 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 3.6 G 2024-04-15T14:51:24.960 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:51:47.735 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-test-debuginfo-19.0.0-3080.gc2d8c315.el9.x 16 MB/s | 703 MB 00:45 2024-04-15T14:51:47.736 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:51:47.736 INFO:teuthology.orchestra.run.smithi164.stdout:Total 16 MB/s | 703 MB 00:45 2024-04-15T14:51:47.736 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:51:47.741 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:51:47.741 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:51:51.889 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:51:51.890 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:52:28.479 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-test-debuginfo-19.0.0-3080.gc2d8c315.el9.x 11 MB/s | 703 MB 01:03 2024-04-15T14:52:28.480 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:52:28.481 INFO:teuthology.orchestra.run.smithi038.stdout:Total 11 MB/s | 703 MB 01:03 2024-04-15T14:52:28.481 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:52:28.486 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:52:28.487 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:52:32.828 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:52:32.828 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:53:08.675 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:53:08.776 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:53:18.484 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-test-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:53:18.763 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:53:18.763 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:18.763 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:53:18.764 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:53:18.764 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:18.764 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:53:19.038 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-base-debuginfo 2024-04-15T14:53:19.624 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:06:50 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:53:19.724 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:53:19.778 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:53:19.779 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-15T14:53:19.779 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:53:19.842 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-debuginfo 2024-04-15T14:53:20.427 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:06:51 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:53:20.580 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 20 M 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:20.581 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 20 M 2024-04-15T14:53:20.582 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 104 M 2024-04-15T14:53:20.582 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:53:22.012 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-mgr-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 14 MB/s | 20 MB 00:01 2024-04-15T14:53:22.013 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:53:22.013 INFO:teuthology.orchestra.run.smithi164.stdout:Total 14 MB/s | 20 MB 00:01 2024-04-15T14:53:22.013 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:53:22.017 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:53:22.017 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:53:22.167 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:53:22.167 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:53:24.447 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:53:24.546 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:53:25.490 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:53:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:53:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:25.770 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:53:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:53:25.770 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:25.770 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:53:25.968 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mds-debuginfo 2024-04-15T14:53:26.551 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:06:57 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:53:26.709 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:53:26.710 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:26.710 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:53:26.710 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:26.710 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:53:26.710 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 54 M 2024-04-15T14:53:26.710 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:26.710 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:53:26.711 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:26.711 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:53:26.711 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:26.711 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 54 M 2024-04-15T14:53:26.711 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 196 M 2024-04-15T14:53:26.711 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:53:29.631 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-mds-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 18 MB/s | 54 MB 00:02 2024-04-15T14:53:29.632 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:53:29.632 INFO:teuthology.orchestra.run.smithi164.stdout:Total 18 MB/s | 54 MB 00:02 2024-04-15T14:53:29.633 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:53:29.637 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:53:29.637 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:53:29.986 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:53:29.986 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:53:35.307 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:53:35.413 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:53:36.878 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:53:37.144 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:53:37.144 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:37.144 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:53:37.144 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:53:37.144 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:37.145 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:53:37.340 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mon-debuginfo 2024-04-15T14:53:37.924 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:07:08 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:53:38.077 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 99 M 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 99 M 2024-04-15T14:53:38.078 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 451 M 2024-04-15T14:53:38.079 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:53:44.358 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-mon-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 16 MB/s | 99 MB 00:06 2024-04-15T14:53:44.358 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:53:44.359 INFO:teuthology.orchestra.run.smithi164.stdout:Total 16 MB/s | 99 MB 00:06 2024-04-15T14:53:44.359 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:53:44.363 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:53:44.363 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:53:44.983 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:53:44.983 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:53:54.595 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:53:54.698 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:53:55.347 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:53:55.447 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:53:58.389 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:53:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:53:58.655 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:58.655 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:53:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:53:58.656 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:58.656 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:53:58.879 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-osd-debuginfo 2024-04-15T14:53:59.461 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:07:30 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:53:59.614 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 290 M 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:53:59.615 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 290 M 2024-04-15T14:53:59.616 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 1.2 G 2024-04-15T14:53:59.616 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:54:04.756 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-test-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:54:05.023 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:54:05.023 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:05.023 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:54:05.023 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:54:05.024 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:05.024 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:54:05.275 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-base-debuginfo 2024-04-15T14:54:05.866 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:07:33 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:54:05.969 INFO:teuthology.orchestra.run.smithi038.stdout:Package ceph-base-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 is already installed. 2024-04-15T14:54:06.025 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:54:06.026 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-15T14:54:06.026 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:54:06.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-debuginfo 2024-04-15T14:54:06.683 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:07:34 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:54:06.843 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:54:06.844 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:06.844 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:54:06.844 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:06.844 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:54:06.844 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 20 M 2024-04-15T14:54:06.844 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:06.844 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:54:06.845 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:06.845 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:54:06.845 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:06.845 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 20 M 2024-04-15T14:54:06.845 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 104 M 2024-04-15T14:54:06.845 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:54:10.974 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-mgr-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 4.9 MB/s | 20 MB 00:04 2024-04-15T14:54:10.975 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:54:10.976 INFO:teuthology.orchestra.run.smithi038.stdout:Total 4.9 MB/s | 20 MB 00:04 2024-04-15T14:54:10.976 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:54:10.980 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:54:10.980 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:54:11.140 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:54:11.140 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:54:13.549 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:54:13.650 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:14.685 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:14.954 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:14.954 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:14.954 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:54:14.954 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:54:14.954 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:14.954 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:54:15.118 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mds-debuginfo 2024-04-15T14:54:15.583 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-osd-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 18 MB/s | 290 MB 00:15 2024-04-15T14:54:15.584 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:54:15.584 INFO:teuthology.orchestra.run.smithi164.stdout:Total 18 MB/s | 290 MB 00:15 2024-04-15T14:54:15.584 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:54:15.588 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:54:15.588 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:54:15.709 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:07:43 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:54:15.867 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:54:15.888 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:15.888 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:54:15.888 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:15.888 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:54:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 54 M 2024-04-15T14:54:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:15.889 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:54:15.889 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:15.889 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:54:15.889 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:15.889 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 54 M 2024-04-15T14:54:15.889 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 196 M 2024-04-15T14:54:15.889 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:54:17.319 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:54:17.319 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:54:18.419 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-mds-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 21 MB/s | 54 MB 00:02 2024-04-15T14:54:18.419 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:54:18.420 INFO:teuthology.orchestra.run.smithi038.stdout:Total 21 MB/s | 54 MB 00:02 2024-04-15T14:54:18.420 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:54:18.424 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:54:18.424 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:54:18.788 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:54:18.788 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:54:24.422 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:54:24.536 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:26.059 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:26.329 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:26.329 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:26.329 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:54:26.329 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:54:26.329 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:26.329 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:54:26.512 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mon-debuginfo 2024-04-15T14:54:27.103 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:07:55 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:54:27.262 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 99 M 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:54:27.263 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:27.264 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 99 M 2024-04-15T14:54:27.264 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 451 M 2024-04-15T14:54:27.264 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:54:38.220 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-mon-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 9.0 MB/s | 99 MB 00:10 2024-04-15T14:54:38.220 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:54:38.221 INFO:teuthology.orchestra.run.smithi038.stdout:Total 9.0 MB/s | 99 MB 00:10 2024-04-15T14:54:38.221 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:54:38.225 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:54:38.225 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:54:38.868 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:54:38.868 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:54:46.981 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:54:47.087 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:49.810 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:54:49.904 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:53.032 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:53.299 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:53.299 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:53.299 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:54:53.299 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:54:53.299 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:53.299 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:54:53.602 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-osd-debuginfo 2024-04-15T14:54:54.191 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:08:22 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:54:54.354 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:54:54.355 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:54.355 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:54:54.355 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:54.355 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:54:54.355 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 290 M 2024-04-15T14:54:54.355 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:54.356 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:54:54.356 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:54:54.356 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:54:54.356 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:54:54.356 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 290 M 2024-04-15T14:54:54.356 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 1.2 G 2024-04-15T14:54:54.356 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:54:54.549 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:54.857 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:54:54.857 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:54:54.857 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:54:54.857 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:54:54.857 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:54:54.857 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:54:55.058 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-fuse-debuginfo 2024-04-15T14:54:55.645 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:08:26 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:54:55.797 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 6.1 M 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:54:55.798 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:54:55.799 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 6.1 M 2024-04-15T14:54:55.799 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 29 M 2024-04-15T14:54:55.799 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:54:57.065 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-fuse-debuginfo-19.0.0-3080.gc2d8c315.el9.x 4.8 MB/s | 6.1 MB 00:01 2024-04-15T14:54:57.066 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:54:57.066 INFO:teuthology.orchestra.run.smithi164.stdout:Total 4.8 MB/s | 6.1 MB 00:01 2024-04-15T14:54:57.066 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:54:57.070 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:54:57.070 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:54:57.140 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:54:57.141 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:54:57.892 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:54:57.997 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:54:58.538 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:54:58.831 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:54:58.831 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:54:58.831 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:54:58.831 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:54:58.831 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:54:58.831 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:54:59.033 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados-devel-debuginfo 2024-04-15T14:54:59.617 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:08:30 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:54:59.768 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:54:59.768 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:54:59.768 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:54:59.768 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:54:59.768 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:54:59.768 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 109 k 2024-04-15T14:54:59.769 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:54:59.769 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:54:59.769 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:54:59.769 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:54:59.769 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:54:59.769 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 109 k 2024-04-15T14:54:59.769 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 440 k 2024-04-15T14:54:59.770 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:00.001 INFO:teuthology.orchestra.run.smithi164.stdout:librados-devel-debuginfo-19.0.0-3080.gc2d8c315. 470 kB/s | 109 kB 00:00 2024-04-15T14:55:00.002 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:00.002 INFO:teuthology.orchestra.run.smithi164.stdout:Total 467 kB/s | 109 kB 00:00 2024-04-15T14:55:00.002 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:00.006 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:00.006 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:00.040 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:00.041 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:00.154 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:00.251 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:55:00.631 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados-devel-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:55:00.923 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:55:00.923 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:00.923 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:55:00.923 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:55:00.923 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:00.923 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:55:01.119 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs2-debuginfo 2024-04-15T14:55:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:08:32 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:55:01.856 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:55:01.856 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:01.856 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:55:01.856 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:01.857 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:55:01.857 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 5.5 M 2024-04-15T14:55:01.857 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:01.857 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:55:01.857 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:01.857 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:55:01.857 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:01.857 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 5.5 M 2024-04-15T14:55:01.858 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 25 M 2024-04-15T14:55:01.858 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:03.754 INFO:teuthology.orchestra.run.smithi164.stdout:libcephfs2-debuginfo-19.0.0-3080.gc2d8c315.el9. 2.9 MB/s | 5.5 MB 00:01 2024-04-15T14:55:03.755 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:03.756 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.9 MB/s | 5.5 MB 00:01 2024-04-15T14:55:03.756 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:03.760 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:03.760 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:03.830 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:03.830 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:04.503 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:04.612 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:55:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:55:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:55:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:05.405 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:55:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:55:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:05.406 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:55:05.605 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados2-debuginfo 2024-04-15T14:55:06.183 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:08:37 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:55:06.336 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:55:06.337 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:06.337 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:55:06.337 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:06.337 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:55:06.337 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 45 M 2024-04-15T14:55:06.337 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:06.338 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:55:06.338 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:06.338 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:55:06.338 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:06.338 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 45 M 2024-04-15T14:55:06.338 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 257 M 2024-04-15T14:55:06.338 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:09.574 INFO:teuthology.orchestra.run.smithi164.stdout:librados2-debuginfo-19.0.0-3080.gc2d8c315.el9.x 14 MB/s | 45 MB 00:03 2024-04-15T14:55:09.575 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:09.575 INFO:teuthology.orchestra.run.smithi164.stdout:Total 14 MB/s | 45 MB 00:03 2024-04-15T14:55:09.576 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:09.580 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:09.580 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:09.887 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:09.887 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:15.061 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:15.157 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:55:16.990 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:55:17.267 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:55:17.268 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:17.268 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:55:17.268 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:55:17.268 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:17.268 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:55:17.500 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librbd1-debuginfo 2024-04-15T14:55:18.079 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:08:49 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:55:18.229 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:55:18.230 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:18.230 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:55:18.230 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:18.230 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:55:18.231 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 52 M 2024-04-15T14:55:18.231 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:18.231 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:55:18.231 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:18.231 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:55:18.231 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:18.231 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 52 M 2024-04-15T14:55:18.231 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 309 M 2024-04-15T14:55:18.231 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:24.926 INFO:teuthology.orchestra.run.smithi164.stdout:librbd1-debuginfo-19.0.0-3080.gc2d8c315.el9.x86 7.8 MB/s | 52 MB 00:06 2024-04-15T14:55:24.927 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:24.927 INFO:teuthology.orchestra.run.smithi164.stdout:Total 7.8 MB/s | 52 MB 00:06 2024-04-15T14:55:24.927 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:24.931 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:24.931 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:25.278 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:25.278 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:31.326 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:31.407 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librbd1-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:55:33.580 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:55:33.866 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:55:33.867 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:33.867 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:55:33.867 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:55:33.867 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:33.867 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:55:34.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-cephfs-debuginfo 2024-04-15T14:55:34.655 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:09:05 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:55:34.809 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:55:34.810 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:34.810 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:55:34.810 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:34.810 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:55:34.810 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 614 k 2024-04-15T14:55:34.810 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:34.810 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:55:34.810 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:34.811 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:55:34.811 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:34.811 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 614 k 2024-04-15T14:55:34.811 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 2.1 M 2024-04-15T14:55:34.811 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:35.378 INFO:teuthology.orchestra.run.smithi164.stdout:python3-cephfs-debuginfo-19.0.0-3080.gc2d8c315. 1.1 MB/s | 614 kB 00:00 2024-04-15T14:55:35.379 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:35.379 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.1 MB/s | 614 kB 00:00 2024-04-15T14:55:35.379 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:35.382 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:35.383 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:35.419 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:35.420 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:35.581 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:35.677 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:55:36.105 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:55:36.383 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:55:36.383 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:36.383 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:55:36.383 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:55:36.383 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:36.383 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:55:36.585 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rados-debuginfo 2024-04-15T14:55:37.158 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:09:08 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:55:37.309 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 770 k 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:55:37.310 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:37.311 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 770 k 2024-04-15T14:55:37.313 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 2.7 M 2024-04-15T14:55:37.313 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:37.623 INFO:teuthology.orchestra.run.smithi164.stdout:python3-rados-debuginfo-19.0.0-3080.gc2d8c315.e 2.4 MB/s | 770 kB 00:00 2024-04-15T14:55:37.623 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:37.624 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.4 MB/s | 770 kB 00:00 2024-04-15T14:55:37.624 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:37.628 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:37.628 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:37.666 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:37.666 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:37.847 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:37.956 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-debuginfo-2:19.0.0-3080.gc2d8c315.el9. 1/1 2024-04-15T14:55:38.349 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: python3-rados-debuginfo-2:19.0.0-3080.gc2d8c315.el9. 1/1 2024-04-15T14:55:38.633 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-3080.gc2d8c315.el9. 1/1 2024-04-15T14:55:38.633 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:38.633 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:55:38.633 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:55:38.633 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:38.633 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:55:38.835 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rbd-debuginfo 2024-04-15T14:55:39.422 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:09:10 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:55:39.575 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 1.1 M 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 1.1 M 2024-04-15T14:55:39.576 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 4.3 M 2024-04-15T14:55:39.577 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:40.109 INFO:teuthology.orchestra.run.smithi164.stdout:python3-rbd-debuginfo-19.0.0-3080.gc2d8c315.el9 2.1 MB/s | 1.1 MB 00:00 2024-04-15T14:55:40.110 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:40.110 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.1 MB/s | 1.1 MB 00:00 2024-04-15T14:55:40.110 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:40.114 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:40.114 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:40.154 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:40.154 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:40.370 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:40.484 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:55:40.901 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:55:41.173 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:55:41.173 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:55:41.174 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:55:41.174 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:55:41.398 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rgw-debuginfo 2024-04-15T14:55:41.982 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:09:12 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:55:42.135 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:55:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:42.136 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:55:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:55:42.136 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 337 k 2024-04-15T14:55:42.136 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:55:42.136 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:55:42.137 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 337 k 2024-04-15T14:55:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 1.0 M 2024-04-15T14:55:42.137 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:42.388 INFO:teuthology.orchestra.run.smithi164.stdout:python3-rgw-debuginfo-19.0.0-3080.gc2d8c315.el9 1.3 MB/s | 337 kB 00:00 2024-04-15T14:55:42.388 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:42.388 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.3 MB/s | 337 kB 00:00 2024-04-15T14:55:42.388 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:42.392 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:42.392 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:42.427 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:42.427 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:42.564 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:42.662 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:55:43.038 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:55:43.323 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:55:43.324 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:43.324 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:55:43.324 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:55:43.324 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:43.324 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:55:43.538 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-fuse-debuginfo 2024-04-15T14:55:44.125 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:09:15 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:55:44.279 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:55:44.279 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 516 k 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 516 k 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 2.6 M 2024-04-15T14:55:44.280 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:44.566 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-fuse-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 1.8 MB/s | 516 kB 00:00 2024-04-15T14:55:44.566 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:44.566 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.8 MB/s | 516 kB 00:00 2024-04-15T14:55:44.567 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:44.570 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:44.570 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:44.607 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:44.607 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:44.768 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:44.864 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:55:45.286 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:55:45.581 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:55:45.581 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:45.581 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:55:45.581 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:55:45.582 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:45.582 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:55:45.792 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-mirror-debuginfo 2024-04-15T14:55:46.377 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:09:17 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:55:46.530 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 52 M 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:55:46.531 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 52 M 2024-04-15T14:55:46.532 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 299 M 2024-04-15T14:55:46.532 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:55:51.310 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-mirror-debuginfo-19.0.0-3080.gc2d8c315.el9. 11 MB/s | 52 MB 00:04 2024-04-15T14:55:51.311 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:51.311 INFO:teuthology.orchestra.run.smithi164.stdout:Total 11 MB/s | 52 MB 00:04 2024-04-15T14:55:51.312 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:55:51.316 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:55:51.316 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:55:51.655 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:55:51.656 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:55:55.240 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-osd-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 4.8 MB/s | 290 MB 01:00 2024-04-15T14:55:55.241 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:55:55.241 INFO:teuthology.orchestra.run.smithi038.stdout:Total 4.8 MB/s | 290 MB 01:00 2024-04-15T14:55:55.242 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:55:55.246 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:55:55.246 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:55:57.056 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:55:57.056 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:55:57.631 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:55:57.733 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:55:59.775 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:56:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:56:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:56:00.056 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:56:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:56:00.056 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:56:00.056 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:56:00.277 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-nbd-debuginfo 2024-04-15T14:56:00.860 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:09:31 ago on Mon 15 Apr 2024 02:46:29 PM UTC. 2024-04-15T14:56:01.011 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-15T14:56:01.011 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:56:01.011 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-15T14:56:01.011 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:56:01.011 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-15T14:56:01.011 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 1.3 M 2024-04-15T14:56:01.011 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:56:01.011 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-15T14:56:01.012 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-15T14:56:01.012 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-15T14:56:01.012 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:56:01.012 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 1.3 M 2024-04-15T14:56:01.012 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 5.7 M 2024-04-15T14:56:01.012 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-15T14:56:01.362 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-nbd-debuginfo-19.0.0-3080.gc2d8c315.el9.x86 3.7 MB/s | 1.3 MB 00:00 2024-04-15T14:56:01.363 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:56:01.363 INFO:teuthology.orchestra.run.smithi164.stdout:Total 3.7 MB/s | 1.3 MB 00:00 2024-04-15T14:56:01.363 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-15T14:56:01.366 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-15T14:56:01.367 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-15T14:56:01.407 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-15T14:56:01.408 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-15T14:56:01.643 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-15T14:56:01.752 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:56:02.182 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:56:02.461 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:56:02.461 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:56:02.461 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-15T14:56:02.461 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:56:02.461 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:56:02.461 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-15T14:56:02.662 DEBUG:teuthology.parallel:result is None 2024-04-15T14:56:28.474 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:56:28.581 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:56:36.167 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:56:36.461 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:56:36.462 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:36.462 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:56:36.462 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:56:36.462 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:36.462 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:56:36.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-fuse-debuginfo 2024-04-15T14:56:37.263 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:05 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:56:37.422 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 6.1 M 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 6.1 M 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 29 M 2024-04-15T14:56:37.423 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:56:38.057 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-fuse-debuginfo-19.0.0-3080.gc2d8c315.el9.x 9.6 MB/s | 6.1 MB 00:00 2024-04-15T14:56:38.058 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:56:38.058 INFO:teuthology.orchestra.run.smithi038.stdout:Total 9.6 MB/s | 6.1 MB 00:00 2024-04-15T14:56:38.058 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:56:38.062 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:56:38.062 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:56:38.134 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:56:38.134 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:56:38.922 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:56:39.025 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:56:39.576 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:56:39.851 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:56:39.851 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:39.851 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:56:39.851 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:56:39.851 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:39.851 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:56:40.022 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados-devel-debuginfo 2024-04-15T14:56:40.617 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:08 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:56:40.774 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:56:40.775 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:40.775 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:56:40.775 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:40.775 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:56:40.776 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 109 k 2024-04-15T14:56:40.776 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:40.776 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:56:40.776 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:40.776 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:56:40.776 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:40.776 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 109 k 2024-04-15T14:56:40.776 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 440 k 2024-04-15T14:56:40.776 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:56:41.151 INFO:teuthology.orchestra.run.smithi038.stdout:librados-devel-debuginfo-19.0.0-3080.gc2d8c315. 290 kB/s | 109 kB 00:00 2024-04-15T14:56:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:56:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:Total 289 kB/s | 109 kB 00:00 2024-04-15T14:56:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:56:41.156 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:56:41.156 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:56:41.192 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:56:41.192 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:56:41.313 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:56:41.411 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:56:41.768 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados-devel-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:56:42.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:56:42.051 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:42.051 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:56:42.051 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:56:42.052 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:42.052 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:56:42.242 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs2-debuginfo 2024-04-15T14:56:42.832 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:10 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:56:42.991 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:56:42.992 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:42.992 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:56:42.992 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:42.992 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:56:42.992 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 5.5 M 2024-04-15T14:56:42.992 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:42.992 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:56:42.993 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:42.993 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:56:42.993 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:42.993 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 5.5 M 2024-04-15T14:56:42.993 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 25 M 2024-04-15T14:56:42.993 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:56:43.580 INFO:teuthology.orchestra.run.smithi038.stdout:libcephfs2-debuginfo-19.0.0-3080.gc2d8c315.el9. 9.3 MB/s | 5.5 MB 00:00 2024-04-15T14:56:43.580 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:56:43.581 INFO:teuthology.orchestra.run.smithi038.stdout:Total 9.3 MB/s | 5.5 MB 00:00 2024-04-15T14:56:43.581 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:56:43.585 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:56:43.585 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:56:43.653 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:56:43.653 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:56:44.367 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:56:44.464 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:56:45.014 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:56:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:56:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:45.284 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:56:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:56:45.284 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:45.284 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:56:45.461 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados2-debuginfo 2024-04-15T14:56:46.051 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:14 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:56:46.210 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:56:46.211 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:46.211 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:56:46.211 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:46.211 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:56:46.211 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 45 M 2024-04-15T14:56:46.212 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:46.212 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:56:46.212 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:46.212 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:56:46.212 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:46.212 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 45 M 2024-04-15T14:56:46.212 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 257 M 2024-04-15T14:56:46.212 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:56:49.766 INFO:teuthology.orchestra.run.smithi038.stdout:librados2-debuginfo-19.0.0-3080.gc2d8c315.el9.x 13 MB/s | 45 MB 00:03 2024-04-15T14:56:49.767 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:56:49.767 INFO:teuthology.orchestra.run.smithi038.stdout:Total 13 MB/s | 45 MB 00:03 2024-04-15T14:56:49.767 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:56:49.772 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:56:49.772 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:56:50.092 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:56:50.093 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:56:55.544 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:56:55.672 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:56:57.829 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:56:58.108 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_ 1/1 2024-04-15T14:56:58.109 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:58.109 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:56:58.109 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:56:58.109 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:58.109 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:56:58.300 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librbd1-debuginfo 2024-04-15T14:56:58.890 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:26 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:56:59.048 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:56:59.048 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:59.048 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:56:59.048 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:59.048 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:56:59.049 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 52 M 2024-04-15T14:56:59.049 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:59.049 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:56:59.049 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:56:59.049 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:56:59.049 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:56:59.049 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 52 M 2024-04-15T14:56:59.049 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 309 M 2024-04-15T14:56:59.049 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:57:06.010 INFO:teuthology.orchestra.run.smithi038.stdout:librbd1-debuginfo-19.0.0-3080.gc2d8c315.el9.x86 7.5 MB/s | 52 MB 00:06 2024-04-15T14:57:06.011 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:57:06.011 INFO:teuthology.orchestra.run.smithi038.stdout:Total 7.5 MB/s | 52 MB 00:06 2024-04-15T14:57:06.011 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:57:06.016 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:57:06.016 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:57:06.379 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:57:06.379 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:57:12.780 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:57:12.886 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librbd1-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:57:15.111 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:57:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:57:15.388 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:15.389 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:57:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:57:15.389 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:15.389 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:57:15.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-cephfs-debuginfo 2024-04-15T14:57:16.186 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:44 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:57:16.347 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:57:16.347 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 614 k 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 614 k 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 2.1 M 2024-04-15T14:57:16.348 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:57:16.762 INFO:teuthology.orchestra.run.smithi038.stdout:python3-cephfs-debuginfo-19.0.0-3080.gc2d8c315. 1.5 MB/s | 614 kB 00:00 2024-04-15T14:57:16.763 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:57:16.763 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.4 MB/s | 614 kB 00:00 2024-04-15T14:57:16.763 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:57:16.767 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:57:16.767 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:57:16.805 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:57:16.805 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:57:16.977 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:57:17.098 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:57:17.494 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:57:17.771 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-3080.gc2d8c315.el9 1/1 2024-04-15T14:57:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:17.772 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:57:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:57:17.772 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:17.772 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:57:17.959 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rados-debuginfo 2024-04-15T14:57:18.550 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:46 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:57:18.708 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:57:18.709 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:18.709 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:57:18.709 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:18.709 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:57:18.710 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 770 k 2024-04-15T14:57:18.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:18.710 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:57:18.710 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:18.710 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:57:18.710 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:18.710 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 770 k 2024-04-15T14:57:18.710 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 2.7 M 2024-04-15T14:57:18.710 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:57:19.148 INFO:teuthology.orchestra.run.smithi038.stdout:python3-rados-debuginfo-19.0.0-3080.gc2d8c315.e 1.7 MB/s | 770 kB 00:00 2024-04-15T14:57:19.149 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:57:19.149 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.7 MB/s | 770 kB 00:00 2024-04-15T14:57:19.149 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:57:19.153 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:57:19.153 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:57:19.192 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:57:19.193 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:57:19.376 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:57:19.501 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-debuginfo-2:19.0.0-3080.gc2d8c315.el9. 1/1 2024-04-15T14:57:19.879 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: python3-rados-debuginfo-2:19.0.0-3080.gc2d8c315.el9. 1/1 2024-04-15T14:57:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-3080.gc2d8c315.el9. 1/1 2024-04-15T14:57:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:20.164 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:57:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:57:20.164 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:20.164 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:57:20.360 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rbd-debuginfo 2024-04-15T14:57:20.949 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:48 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:57:21.109 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:57:21.110 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:21.110 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:57:21.110 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:21.110 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:57:21.110 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 1.1 M 2024-04-15T14:57:21.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:21.110 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:57:21.110 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:21.110 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:57:21.111 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:21.111 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 1.1 M 2024-04-15T14:57:21.111 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 4.3 M 2024-04-15T14:57:21.111 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:57:21.419 INFO:teuthology.orchestra.run.smithi038.stdout:python3-rbd-debuginfo-19.0.0-3080.gc2d8c315.el9 3.7 MB/s | 1.1 MB 00:00 2024-04-15T14:57:21.419 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:57:21.419 INFO:teuthology.orchestra.run.smithi038.stdout:Total 3.6 MB/s | 1.1 MB 00:00 2024-04-15T14:57:21.420 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:57:21.423 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:57:21.423 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:57:21.465 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:57:21.465 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:57:21.693 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:57:21.813 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:57:22.252 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:57:22.539 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:57:22.539 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:22.539 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:57:22.539 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:57:22.539 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:22.539 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:57:22.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rgw-debuginfo 2024-04-15T14:57:23.332 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:51 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:57:23.492 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:57:23.493 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:23.493 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:57:23.493 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:23.493 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:57:23.493 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 337 k 2024-04-15T14:57:23.493 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:23.493 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:57:23.493 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:23.494 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:57:23.494 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:23.494 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 337 k 2024-04-15T14:57:23.494 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 1.0 M 2024-04-15T14:57:23.494 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:57:23.888 INFO:teuthology.orchestra.run.smithi038.stdout:python3-rgw-debuginfo-19.0.0-3080.gc2d8c315.el9 857 kB/s | 337 kB 00:00 2024-04-15T14:57:23.889 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:57:23.889 INFO:teuthology.orchestra.run.smithi038.stdout:Total 854 kB/s | 337 kB 00:00 2024-04-15T14:57:23.889 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:57:23.892 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:57:23.892 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:57:23.930 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:57:23.930 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:57:24.073 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:57:24.189 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:57:24.575 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:57:24.846 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x8 1/1 2024-04-15T14:57:24.846 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:57:24.846 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:57:24.846 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:57:25.046 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-fuse-debuginfo 2024-04-15T14:57:25.637 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:53 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:57:25.796 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 516 k 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:57:25.797 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:25.798 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 516 k 2024-04-15T14:57:25.798 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 2.6 M 2024-04-15T14:57:25.798 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:57:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-fuse-debuginfo-19.0.0-3080.gc2d8c315.el9.x8 1.3 MB/s | 516 kB 00:00 2024-04-15T14:57:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:57:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.3 MB/s | 516 kB 00:00 2024-04-15T14:57:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:57:26.187 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:57:26.187 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:57:26.226 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:57:26.226 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:57:26.389 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:57:26.501 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:57:26.895 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:57:27.170 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_6 1/1 2024-04-15T14:57:27.170 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:27.171 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:57:27.171 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:57:27.171 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:27.171 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:57:27.348 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-mirror-debuginfo 2024-04-15T14:57:27.941 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:10:55 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:57:28.101 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:57:28.102 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:28.102 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:57:28.102 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:28.102 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:57:28.102 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 52 M 2024-04-15T14:57:28.102 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:28.102 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:57:28.102 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:28.102 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:57:28.103 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:28.103 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 52 M 2024-04-15T14:57:28.103 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 299 M 2024-04-15T14:57:28.103 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:57:30.594 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-mirror-debuginfo-19.0.0-3080.gc2d8c315.el9. 21 MB/s | 52 MB 00:02 2024-04-15T14:57:30.595 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:57:30.595 INFO:teuthology.orchestra.run.smithi038.stdout:Total 21 MB/s | 52 MB 00:02 2024-04-15T14:57:30.596 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:57:30.600 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:57:30.600 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:57:30.953 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:57:30.953 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:57:37.237 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:57:37.337 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:57:39.444 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:57:39.727 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86 1/1 2024-04-15T14:57:39.727 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:39.727 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:57:39.727 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:57:39.727 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:39.727 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:57:39.911 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-nbd-debuginfo 2024-04-15T14:57:40.502 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:11:08 ago on Mon 15 Apr 2024 02:46:32 PM UTC. 2024-04-15T14:57:40.667 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-15T14:57:40.720 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:40.720 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-04-15T14:57:40.720 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:40.720 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-15T14:57:40.721 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-3080.gc2d8c315.el9 ceph 1.3 M 2024-04-15T14:57:40.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:40.721 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-15T14:57:40.721 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-04-15T14:57:40.722 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-04-15T14:57:40.722 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:40.722 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 1.3 M 2024-04-15T14:57:40.723 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 5.7 M 2024-04-15T14:57:40.723 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-15T14:57:40.954 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-nbd-debuginfo-19.0.0-3080.gc2d8c315.el9.x86 4.4 MB/s | 1.3 MB 00:00 2024-04-15T14:57:40.955 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-15T14:57:40.955 INFO:teuthology.orchestra.run.smithi038.stdout:Total 4.4 MB/s | 1.3 MB 00:00 2024-04-15T14:57:40.955 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-15T14:57:40.959 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-15T14:57:40.959 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-15T14:57:41.002 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-15T14:57:41.002 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-15T14:57:41.254 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-15T14:57:41.373 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:57:41.790 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:57:42.176 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 1/1 2024-04-15T14:57:42.176 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:42.176 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-15T14:57:42.176 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-debuginfo-2:19.0.0-3080.gc2d8c315.el9.x86_64 2024-04-15T14:57:42.176 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:42.176 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-15T14:57:42.356 DEBUG:teuthology.parallel:result is None 2024-04-15T14:57:42.356 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2d8c3155d854ee204cb7c7261232571229d1d54 2024-04-15T14:57:42.503 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T14:57:42.524 INFO:teuthology.orchestra.run.smithi038.stdout:19.0.0-3080.gc2d8c315.el9 2024-04-15T14:57:42.525 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3080.gc2d8c315.el9 2024-04-15T14:57:42.525 INFO:teuthology.task.install:The correct ceph version 19.0.0-3080.gc2d8c315 is installed. 2024-04-15T14:57:42.527 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2d8c3155d854ee204cb7c7261232571229d1d54 2024-04-15T14:57:42.744 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T14:57:42.770 INFO:teuthology.orchestra.run.smithi164.stdout:19.0.0-3080.gc2d8c315.el9 2024-04-15T14:57:42.770 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3080.gc2d8c315.el9 2024-04-15T14:57:42.770 INFO:teuthology.task.install:The correct ceph version 19.0.0-3080.gc2d8c315 is installed. 2024-04-15T14:57:42.772 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-15T14:57:42.773 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:42.773 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T14:57:42.801 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:57:42.801 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T14:57:42.844 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-15T14:57:42.844 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:42.844 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T14:57:42.872 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T14:57:42.941 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:57:42.941 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T14:57:42.973 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T14:57:43.044 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-15T14:57:43.045 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:43.045 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T14:57:43.073 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T14:57:43.140 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:57:43.141 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T14:57:43.170 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T14:57:43.240 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-15T14:57:43.240 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:43.240 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T14:57:43.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T14:57:43.337 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:57:43.337 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T14:57:43.367 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T14:57:43.439 INFO:teuthology.run_tasks:Running task ceph... 2024-04-15T14:57:43.550 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-15T14:57:43.550 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2024-04-15T14:57:43.554 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-04-15T14:57:43.584 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-15T14:57:43.585 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T14:57:43.622 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T14:57:43.652 INFO:tasks.ceph:Creating extra log directories... 2024-04-15T14:57:43.653 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T14:57:43.691 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T14:57:43.733 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-15T14:57:43.733 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-04-15T14:57:43.733 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826', 'branch': 'main', 'description': 'rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7655826', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'mon_bind_msgr2': False, 'sha1': 'c2d8c3155d854ee204cb7c7261232571229d1d54', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'c2d8c3155d854ee204cb7c7261232571229d1d54'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '87dbfb632e974cb2c28d17423071d2d833b53b29'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 951, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5211, 'sha1': 'c2d8c3155d854ee204cb7c7261232571229d1d54', 'sleep_before_teardown': 0, 'subset': '28113/100000', 'suite': 'rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '87dbfb632e974cb2c28d17423071d2d833b53b29', 'targets': {'smithi038.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOLjzXDOzgXZQzVqhxbG5Oakkk3pLU1R4C0TuVLccquskFlqweIMfmsWvL47IjkpEc1eUIoV8iPCP89JL9dNZr8=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOA2DT3B/BUm0x9GQsawbta3I49Xp2q/1coiuBPx+TZRq/IS+v/NygeXz5+t3MTUkiiiHuDSg4orcWGbJoygu1M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-14_20:00:15', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-15T14:57:43.734 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T14:57:43.760 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T14:57:43.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T14:57:43.815 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T14:57:43.850 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:43.850 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T14:57:43.896 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T14:57:43.896 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2024-04-15T14:57:43.951 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T14:57:43.951 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T14:57:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-15T14:57:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T14:57:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T14:57:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-04-15 14:48:28.908061084 +0000 2024-04-15T14:57:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-04-15 14:45:40.350715566 +0000 2024-04-15T14:57:43.952 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-04-15 14:45:40.350715566 +0000 2024-04-15T14:57:43.952 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-04-15 14:45:40.350715566 +0000 2024-04-15T14:57:43.952 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T14:57:44.018 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-04-15T14:57:44.018 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-04-15T14:57:44.018 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.00029052 s, 1.8 MB/s 2024-04-15T14:57:44.019 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T14:57:44.076 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2024-04-15T14:57:44.131 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T14:57:44.131 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T14:57:44.131 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-15T14:57:44.131 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T14:57:44.131 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T14:57:44.131 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-04-15 14:48:28.909061064 +0000 2024-04-15T14:57:44.132 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-04-15 14:45:40.716708185 +0000 2024-04-15T14:57:44.132 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-04-15 14:45:40.716708185 +0000 2024-04-15T14:57:44.132 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-04-15 14:45:40.716708185 +0000 2024-04-15T14:57:44.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T14:57:44.198 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-04-15T14:57:44.198 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-04-15T14:57:44.198 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000265218 s, 1.9 MB/s 2024-04-15T14:57:44.199 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T14:57:44.256 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2024-04-15T14:57:44.311 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T14:57:44.311 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T14:57:44.311 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-15T14:57:44.311 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T14:57:44.311 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T14:57:44.311 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-04-15 14:48:28.909061064 +0000 2024-04-15T14:57:44.311 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-04-15 14:45:41.075700945 +0000 2024-04-15T14:57:44.311 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-04-15 14:45:41.075700945 +0000 2024-04-15T14:57:44.311 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-04-15 14:45:41.075700945 +0000 2024-04-15T14:57:44.311 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T14:57:44.377 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-04-15T14:57:44.377 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-04-15T14:57:44.377 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000277197 s, 1.8 MB/s 2024-04-15T14:57:44.378 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T14:57:44.434 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2024-04-15T14:57:44.490 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T14:57:44.490 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T14:57:44.490 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-15T14:57:44.490 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T14:57:44.490 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T14:57:44.490 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-04-15 14:48:28.910061045 +0000 2024-04-15T14:57:44.491 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-04-15 14:45:41.430693785 +0000 2024-04-15T14:57:44.491 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-04-15 14:45:41.430693785 +0000 2024-04-15T14:57:44.491 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-04-15 14:45:41.430693785 +0000 2024-04-15T14:57:44.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T14:57:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-04-15T14:57:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-04-15T14:57:44.557 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.00034876 s, 1.5 MB/s 2024-04-15T14:57:44.559 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T14:57:44.615 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T14:57:44.615 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:57:44.615 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T14:57:44.633 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T14:57:44.633 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-04-15T14:57:44.689 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T14:57:44.689 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T14:57:44.689 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-15T14:57:44.689 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T14:57:44.690 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T14:57:44.690 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-15 14:48:19.260799621 +0000 2024-04-15T14:57:44.690 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-15 14:45:36.786266470 +0000 2024-04-15T14:57:44.690 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-15 14:45:36.786266470 +0000 2024-04-15T14:57:44.690 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-15 14:45:36.786266470 +0000 2024-04-15T14:57:44.690 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T14:57:44.757 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-15T14:57:44.758 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-15T14:57:44.758 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000207674 s, 2.5 MB/s 2024-04-15T14:57:44.759 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T14:57:44.815 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-04-15T14:57:44.871 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T14:57:44.871 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T14:57:44.872 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-15T14:57:44.872 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T14:57:44.872 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T14:57:44.872 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-15 14:48:19.261799605 +0000 2024-04-15T14:57:44.872 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-15 14:45:37.137260529 +0000 2024-04-15T14:57:44.872 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-15 14:45:37.137260529 +0000 2024-04-15T14:57:44.872 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-15 14:45:37.137260529 +0000 2024-04-15T14:57:44.872 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T14:57:44.939 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-15T14:57:44.939 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-15T14:57:44.939 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000196054 s, 2.6 MB/s 2024-04-15T14:57:44.940 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T14:57:44.996 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-04-15T14:57:45.051 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T14:57:45.051 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T14:57:45.051 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-15T14:57:45.051 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T14:57:45.051 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T14:57:45.051 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-15 14:48:19.261799605 +0000 2024-04-15T14:57:45.051 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-15 14:45:37.483254673 +0000 2024-04-15T14:57:45.051 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-15 14:45:37.483254673 +0000 2024-04-15T14:57:45.051 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-15 14:45:37.483254673 +0000 2024-04-15T14:57:45.052 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T14:57:45.117 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-15T14:57:45.117 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-15T14:57:45.117 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000268029 s, 1.9 MB/s 2024-04-15T14:57:45.118 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T14:57:45.175 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-04-15T14:57:45.230 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T14:57:45.230 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T14:57:45.230 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-15T14:57:45.230 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T14:57:45.230 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T14:57:45.230 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-15 14:48:19.261799605 +0000 2024-04-15T14:57:45.230 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-15 14:45:37.845248546 +0000 2024-04-15T14:57:45.230 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-15 14:45:37.845248546 +0000 2024-04-15T14:57:45.230 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-15 14:45:37.845248546 +0000 2024-04-15T14:57:45.231 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T14:57:45.296 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-15T14:57:45.297 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-15T14:57:45.297 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000185071 s, 2.8 MB/s 2024-04-15T14:57:45.298 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T14:57:45.354 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T14:57:45.354 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-15T14:57:45.354 INFO:tasks.ceph:Generating config... 2024-04-15T14:57:45.356 INFO:tasks.ceph:[client] debug monc = 20 2024-04-15T14:57:45.356 INFO:tasks.ceph:[client] debug ms = 1 2024-04-15T14:57:45.356 INFO:tasks.ceph:[client] debug objecter = 20 2024-04-15T14:57:45.356 INFO:tasks.ceph:[client] debug rados = 20 2024-04-15T14:57:45.356 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-04-15T14:57:45.356 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-04-15T14:57:45.356 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-04-15T14:57:45.356 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-04-15T14:57:45.356 INFO:tasks.ceph:[global] ms type = async 2024-04-15T14:57:45.356 INFO:tasks.ceph:[global] osd heartbeat grace = 80 2024-04-15T14:57:45.356 INFO:tasks.ceph:[global] osd op thread timeout = 150 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-04-15T14:57:45.357 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-04-15T14:57:45.358 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] debug bluefs = 1 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] debug bluestore = 1 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] debug monc = 20 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-15T14:57:45.358 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd class default list = * 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd class load list = * 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd client watch timeout = 120 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-04-15T14:57:45.359 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-15T14:57:45.360 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-04-15T14:57:45.360 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-04-15T14:57:45.360 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-15T14:57:45.360 INFO:tasks.ceph:Setting up mon.a... 2024-04-15T14:57:45.360 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-15T14:57:45.416 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2024-04-15T14:57:45.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-15T14:57:45.469 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T14:57:45.498 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.38:6789]'), ('mon.c', '[v1:172.21.15.38:6790]'), ('mon.b', '[v1:172.21.15.164:6789]')] 2024-04-15T14:57:45.498 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.38:6789],[v1:172.21.15.38:6790],[v1:172.21.15.164:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-15T14:57:45.499 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:45.499 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-15T14:57:45.554 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.38:6789]' --addv c '[v1:172.21.15.38:6790]' --addv b '[v1:172.21.15.164:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:57:45.641 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = quincy 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 17 (quincy) 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:election_strategy: 3 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:57:45.642 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-15T14:57:45.644 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-15T14:57:45.659 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID faa113cf-e8b3-4b6c-9186-1faf4aadaf02... 2024-04-15T14:57:45.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T14:57:45.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T14:57:45.753 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2024-04-15T14:57:45.753 INFO:teuthology.orchestra.run.smithi038.stdout: chdir = "" 2024-04-15T14:57:45.753 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T14:57:45.753 INFO:teuthology.orchestra.run.smithi038.stdout: auth supported = cephx 2024-04-15T14:57:45.753 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.753 INFO:teuthology.orchestra.run.smithi038.stdout: filestore xattr use omap = true 2024-04-15T14:57:45.753 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.753 INFO:teuthology.orchestra.run.smithi038.stdout: mon clock drift allowed = 1.000 2024-04-15T14:57:45.753 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: osd crush chooseleaf type = 0 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: auth debug = true 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on old message = true 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on bug = true 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn max object skew = 0 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.754 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default size = 2 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow primary affinity = true 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow pg remap = true 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on legacy crush tunables = false 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on crush straw calc version zero = false 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on no sortbitwise = false 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on osd down out interval zero = false 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on too few osds = false 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon_allow_pool_size_one = true 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T14:57:45.755 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd default data pool replay window = 5 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: mon allow pool delete = true 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: mon cluster log file level = debug 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: debug asserts on shutdown = true 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: mon health detail to clog = false 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: mon host = "[v1:172.21.15.38:6789],[v1:172.21.15.38:6790],[v1:172.21.15.164:6789]" 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: mon client directed command retry = 5 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: mon election default strategy = 3 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: ms bind msgr2 = False 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: ms inject socket failures = 5000 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: ms type = async 2024-04-15T14:57:45.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd heartbeat grace = 80 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: osd op thread timeout = 150 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout:[osd] 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: osd journal size = 100 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub load threshold = 5.0 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub max interval = 600 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: osd mclock profile = high_recovery_ops 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: osd recover clone overlap = true 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: osd recovery max chunk = 1048576 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.757 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug shutdown = true 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug op order = true 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify stray on activate = true 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug trim objects = true 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd open classes on start = true 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug pg log writeout = true 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd deep scrub update digest min age = 30 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd map max advance = 10 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: journal zero on create = true 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.758 INFO:teuthology.orchestra.run.smithi038.stdout: filestore ondisk finisher threads = 3 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: filestore apply finisher threads = 3 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: bdev debug aio = true 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug misdirected ops = true 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: bluefs allocator = hybrid 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore allocator = hybrid 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore block size = 96636764160 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore fsck on mount = True 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore zero block detection = True 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluefs = 1 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluestore = 1 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug monc = 20 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-04-15T14:57:45.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug osd = 20 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: debug rocksdb = 10 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.9 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.8 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: osd class default list = * 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: osd class load list = * 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: osd client watch timeout = 120 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify cached snaps = True 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify missing on start = True 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: osd failsafe full ratio = 0.95 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: osd fast shutdown = False 2024-04-15T14:57:45.760 INFO:teuthology.orchestra.run.smithi038.stdout: osd mclock override recovery settings = True 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: osd objectstore = bluestore 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: osd op queue = debug_random 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: osd op queue cut off = debug_random 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: osd shutdown pgref assert = True 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr] 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: debug mgr = 20 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: mgr/telemetry/nag = false 2024-04-15T14:57:45.761 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout:[mon] 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: debug paxos = 20 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: mon data avail warn = 5 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: mon mgr mkfs grace = 240 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd reporter subtree level = osd 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd prime pg temp = true 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T14:57:45.762 INFO:teuthology.orchestra.run.smithi038.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: # 1m isn't quite enough 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: mon_down_mkfs_grace = 2m 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_filestore_osds = false 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: mon min osdmap epochs = 50 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd crush smoke test = False 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: mon osdmap full prune interval = 2 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: mon osdmap full prune min = 15 2024-04-15T14:57:45.763 INFO:teuthology.orchestra.run.smithi038.stdout: mon osdmap full prune txsize = 2 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: mon scrub interval = 300 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on pool no app = False 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: paxos service trim min = 10 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout:[client] 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: rgw cache enabled = true 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable ops log = true 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable usage log = true 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: debug monc = 20 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: debug objecter = 20 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout: debug rados = 20 2024-04-15T14:57:45.764 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.a] 2024-04-15T14:57:45.765 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.c] 2024-04-15T14:57:45.765 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.b] 2024-04-15T14:57:45.765 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-04-15T14:57:45.765 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-04-15T14:57:45.765 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T14:57:45.765 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-04-15T14:57:45.765 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.765 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-04-15T14:57:45.765 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T14:57:45.766 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-04-15T14:57:45.767 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "[v1:172.21.15.38:6789],[v1:172.21.15.38:6790],[v1:172.21.15.164:6789]" 2024-04-15T14:57:45.768 INFO:teuthology.orchestra.run.smithi164.stdout: mon client directed command retry = 5 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: mon election default strategy = 3 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: ms bind msgr2 = False 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject socket failures = 5000 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: ms type = async 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: osd heartbeat grace = 80 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: osd op thread timeout = 150 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-04-15T14:57:45.769 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-04-15T14:57:45.770 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: bluefs allocator = hybrid 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = hybrid 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore zero block detection = True 2024-04-15T14:57:45.771 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: debug monc = 20 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: osd class default list = * 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: osd class load list = * 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: osd client watch timeout = 120 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify cached snaps = True 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify missing on start = True 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-04-15T14:57:45.772 INFO:teuthology.orchestra.run.smithi164.stdout: osd fast shutdown = False 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock override recovery settings = True 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: osd op queue = debug_random 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: osd op queue cut off = debug_random 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: osd shutdown pgref assert = True 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-15T14:57:45.773 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-15T14:57:45.774 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.775 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T14:57:45.775 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T14:57:45.775 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T14:57:45.775 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.775 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T14:57:45.775 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T14:57:45.775 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T14:57:45.775 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.775 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: mon min osdmap epochs = 50 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd crush smoke test = False 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: mon osdmap full prune interval = 2 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: mon osdmap full prune min = 15 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: mon osdmap full prune txsize = 2 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: mon scrub interval = 300 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on pool no app = False 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: paxos service trim min = 10 2024-04-15T14:57:45.776 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout: debug monc = 20 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout: debug objecter = 20 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout: debug rados = 20 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-04-15T14:57:45.777 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-04-15T14:57:45.779 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-15T14:57:45.779 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-15T14:57:45.876 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-15T14:57:45.876 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:45.876 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-15T14:57:45.892 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:45.892 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-15T14:57:45.947 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T14:57:45.947 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:45.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T14:57:45.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T14:57:46.029 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:57:46.029 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:57:46.085 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T14:57:46.085 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:57:46.085 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T14:57:46.085 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T14:57:46.127 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:57:46.127 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:57:46.184 INFO:tasks.ceph:Setting up mon nodes... 2024-04-15T14:57:46.184 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-15T14:57:46.184 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-15T14:57:46.241 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-15T14:57:46.244 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-15T14:57:46.311 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-15T14:57:46.312 INFO:tasks.ceph:Setting up mds nodes... 2024-04-15T14:57:46.312 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-15T14:57:46.312 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-15T14:57:46.357 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-15T14:57:46.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-15T14:57:46.419 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-15T14:57:46.435 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-15T14:57:46.435 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-15T14:57:46.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-15T14:57:46.463 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T14:57:46.463 INFO:tasks.ceph:role: osd.0 2024-04-15T14:57:46.463 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T14:57:46.463 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T14:57:46.559 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T14:57:46.559 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T14:57:46.559 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T14:57:46.560 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T14:57:46.560 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T14:57:46.560 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-04-15T14:57:46.560 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T14:57:46.560 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T14:57:46.560 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T14:57:46.560 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T14:57:47.877 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-04-15T14:57:47.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-04-15T14:57:47.880 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-15T14:57:47.935 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-15T14:57:47.969 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-15T14:57:48.040 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T14:57:48.040 INFO:tasks.ceph:role: osd.1 2024-04-15T14:57:48.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T14:57:48.040 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T14:57:48.137 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T14:57:49.459 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-04-15T14:57:49.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-04-15T14:57:49.462 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-15T14:57:49.500 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-15T14:57:49.576 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-15T14:57:49.646 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T14:57:49.646 INFO:tasks.ceph:role: osd.2 2024-04-15T14:57:49.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T14:57:49.647 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-15T14:57:49.744 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T14:57:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T14:57:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T14:57:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T14:57:49.744 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T14:57:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-04-15T14:57:49.744 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T14:57:49.744 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T14:57:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T14:57:49.745 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T14:57:51.100 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-04-15T14:57:51.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-04-15T14:57:51.102 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-15T14:57:51.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-15T14:57:51.184 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-15T14:57:51.255 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-15T14:57:51.255 INFO:tasks.ceph:role: osd.3 2024-04-15T14:57:51.255 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T14:57:51.255 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-15T14:57:51.353 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T14:57:51.353 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T14:57:51.353 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T14:57:51.353 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T14:57:51.353 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T14:57:51.353 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2024-04-15T14:57:51.353 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T14:57:51.353 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T14:57:51.353 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T14:57:51.354 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T14:57:52.677 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2024-04-15T14:57:52.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2024-04-15T14:57:52.679 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-15T14:57:52.722 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-15T14:57:52.797 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:57:52.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:52.899+0000 7f1488606640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-15T14:57:52.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:52.899+0000 7f1488606640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-15T14:57:52.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:52.899+0000 7f1488606640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T14:57:52.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:52.899+0000 7f1488606640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T14:57:52.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:52.899+0000 7f1488606640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T14:57:52.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:52.900+0000 7f1488606640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-15T14:57:55.769 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-15T14:57:55.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:57:55.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:55.895+0000 7fe3daab5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-15T14:57:55.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:55.895+0000 7fe3daab5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-15T14:57:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:55.895+0000 7fe3daab5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T14:57:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:55.895+0000 7fe3daab5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T14:57:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:55.895+0000 7fe3daab5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T14:57:55.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:55.896+0000 7fe3daab5640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-15T14:57:58.754 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-15T14:57:58.787 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:57:58.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:58.880+0000 7f4aec412640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-15T14:57:58.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:58.881+0000 7f4aec412640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-15T14:57:58.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:58.881+0000 7f4aec412640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T14:57:58.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:58.881+0000 7f4aec412640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T14:57:58.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:58.881+0000 7f4aec412640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T14:57:58.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:57:58.881+0000 7f4aec412640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-15T14:58:01.761 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-15T14:58:01.794 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:58:01.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:01.886+0000 7fa8879bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-15T14:58:01.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:01.886+0000 7fa8879bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-15T14:58:01.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:01.886+0000 7fa8879bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T14:58:01.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:01.886+0000 7fa8879bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T14:58:01.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:01.886+0000 7fa8879bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-15T14:58:01.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:01.887+0000 7fa8879bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-15T14:58:04.759 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-15T14:58:04.793 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-15T14:58:04.827 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T14:58:04.827 INFO:tasks.ceph:role: osd.4 2024-04-15T14:58:04.827 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T14:58:04.828 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T14:58:04.907 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T14:58:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T14:58:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T14:58:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T14:58:04.907 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T14:58:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-15T14:58:04.908 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T14:58:04.908 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T14:58:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T14:58:04.908 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T14:58:05.418 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-15T14:58:05.421 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-15T14:58:05.421 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-15T14:58:05.580 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-15T14:58:05.619 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-15T14:58:05.692 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T14:58:05.692 INFO:tasks.ceph:role: osd.5 2024-04-15T14:58:05.692 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T14:58:05.692 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-15T14:58:05.768 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T14:58:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T14:58:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T14:58:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T14:58:05.769 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T14:58:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-15T14:58:05.769 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T14:58:05.769 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T14:58:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T14:58:05.769 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T14:58:06.221 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-15T14:58:06.223 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-15T14:58:06.223 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-15T14:58:06.323 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-15T14:58:06.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-15T14:58:06.427 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T14:58:06.427 INFO:tasks.ceph:role: osd.6 2024-04-15T14:58:06.427 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T14:58:06.427 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-15T14:58:06.504 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T14:58:06.505 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T14:58:06.505 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T14:58:06.505 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T14:58:06.505 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T14:58:06.505 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-15T14:58:06.505 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T14:58:06.505 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T14:58:06.505 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T14:58:06.505 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T14:58:06.992 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-15T14:58:06.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-15T14:58:06.994 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-15T14:58:07.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-15T14:58:07.185 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-15T14:58:07.256 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-15T14:58:07.257 INFO:tasks.ceph:role: osd.7 2024-04-15T14:58:07.257 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T14:58:07.257 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-15T14:58:07.333 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T14:58:07.334 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T14:58:07.334 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T14:58:07.334 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T14:58:07.334 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T14:58:07.334 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-15T14:58:07.334 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T14:58:07.334 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T14:58:07.334 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T14:58:07.334 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T14:58:07.853 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-15T14:58:07.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-15T14:58:07.855 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-15T14:58:07.995 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-15T14:58:08.031 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:58:08.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:08.131+0000 7f567bc14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-15T14:58:08.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:08.132+0000 7f567bc14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-15T14:58:08.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:08.132+0000 7f567bc14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T14:58:08.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:08.132+0000 7f567bc14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T14:58:08.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:08.132+0000 7f567bc14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-15T14:58:08.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:08.132+0000 7f567bc14640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-15T14:58:10.982 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-15T14:58:11.016 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:58:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:11.109+0000 7fe1a3411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-15T14:58:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:11.110+0000 7fe1a3411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-15T14:58:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:11.110+0000 7fe1a3411640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T14:58:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:11.110+0000 7fe1a3411640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T14:58:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:11.110+0000 7fe1a3411640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-15T14:58:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:11.110+0000 7fe1a3411640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-15T14:58:13.958 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-15T14:58:13.991 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:58:14.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:14.084+0000 7fad73eb5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-15T14:58:14.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:14.085+0000 7fad73eb5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-15T14:58:14.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:14.085+0000 7fad73eb5640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T14:58:14.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:14.085+0000 7fad73eb5640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T14:58:14.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:14.085+0000 7fad73eb5640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-15T14:58:14.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:14.085+0000 7fad73eb5640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-15T14:58:16.932 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-15T14:58:16.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:58:17.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:17.055+0000 7f83fbc21640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-15T14:58:17.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:17.055+0000 7f83fbc21640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-15T14:58:17.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:17.055+0000 7f83fbc21640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T14:58:17.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:17.055+0000 7f83fbc21640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T14:58:17.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:17.055+0000 7f83fbc21640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-15T14:58:17.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:17.056+0000 7f83fbc21640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-15T14:58:19.908 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-15T14:58:19.941 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-15T14:58:19.941 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:19.941 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-15T14:58:19.975 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:19.975 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-15T14:58:20.047 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:20.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-15T14:58:20.118 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:20.118 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-15T14:58:20.189 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:20.189 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-15T14:58:20.259 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:20.259 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-15T14:58:20.292 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:20.292 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-15T14:58:20.365 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:20.366 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-15T14:58:20.436 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:20.436 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-15T14:58:20.507 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:20.507 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-15T14:58:20.577 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:20.577 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-15T14:58:20.596 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:20.596 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-15T14:58:20.633 INFO:tasks.ceph:Adding keys to all mons... 2024-04-15T14:58:20.634 DEBUG:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-15T14:58:20.638 DEBUG:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-15T14:58:20.677 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2024-04-15T14:58:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBqQB1miRljDhAANifwKFVgzIUg1n4hSit1gw== 2024-04-15T14:58:20.677 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2024-04-15T14:58:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBwQB1mYv2mNRAAOlVFWjbt0CVqBgGmCUXNEg== 2024-04-15T14:58:20.677 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2024-04-15T14:58:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBzQB1mo09tNRAAn5LL/63IqH4Ho2g0oQHKlQ== 2024-04-15T14:58:20.677 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2024-04-15T14:58:20.677 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQB2QB1mZ2KKNBAA5GhgyqGvJV1yYW1eYuAdSQ== 2024-04-15T14:58:20.677 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.3] 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQB5QB1mF/3vNBAA8ml3wZ/cKixbvxv8bxUiCw== 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBqQB1mPjhUEhAAZF6iWlU1ArH4ESHe9utnxw== 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.4] 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCAQB1mzqfnBxAAeB4wJb8yVz2L/uJpbtO/0Q== 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.5] 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCDQB1myCGWBhAA0Hen4/0pVU9RXKpkwpr3Kg== 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.6] 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCGQB1meOgZBRAAjwKQeCJ1IFwG5MlqPzqZTg== 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.7] 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCJQB1mzlpUAxAA0ycniP4gOb2DcAHkRkoujA== 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBqQB1m8kVIFRAAABee32kAjHDEXCtxjjeMTg== 2024-04-15T14:58:20.678 INFO:teuthology.orchestra.run.smithi038.stdout:[client.1] 2024-04-15T14:58:20.679 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBqQB1m23EBGRAADH5n5Om7NaDXo67ODagJiQ== 2024-04-15T14:58:20.702 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBqQB1miRljDhAANifwKFVgzIUg1n4hSit1gw== 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBwQB1mYv2mNRAAOlVFWjbt0CVqBgGmCUXNEg== 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBzQB1mo09tNRAAn5LL/63IqH4Ho2g0oQHKlQ== 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB2QB1mZ2KKNBAA5GhgyqGvJV1yYW1eYuAdSQ== 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB5QB1mF/3vNBAA8ml3wZ/cKixbvxv8bxUiCw== 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBqQB1mPjhUEhAAZF6iWlU1ArH4ESHe9utnxw== 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2024-04-15T14:58:20.703 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCAQB1mzqfnBxAAeB4wJb8yVz2L/uJpbtO/0Q== 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCDQB1myCGWBhAA0Hen4/0pVU9RXKpkwpr3Kg== 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCGQB1meOgZBRAAjwKQeCJ1IFwG5MlqPzqZTg== 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCJQB1mzlpUAxAA0ycniP4gOb2DcAHkRkoujA== 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBqQB1m8kVIFRAAABee32kAjHDEXCtxjjeMTg== 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout:[client.1] 2024-04-15T14:58:20.704 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBqQB1m23EBGRAADH5n5Om7NaDXo67ODagJiQ== 2024-04-15T14:58:20.705 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T14:58:20.722 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T14:58:20.803 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:20.805 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:20.860 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:20.862 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:20.916 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:20.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:20.973 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:20.976 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:21.030 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T14:58:21.032 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T14:58:21.086 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:21.088 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:21.142 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:21.145 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:21.199 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:21.201 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:21.256 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:21.259 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T14:58:21.313 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T14:58:21.316 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T14:58:21.373 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T14:58:21.376 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T14:58:21.433 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-15T14:58:21.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-15T14:58:21.461 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T14:58:21.571 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-15T14:58:21.601 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-15T14:58:21.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T14:58:21.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-15T14:58:21.828 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-15T14:58:21.857 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T14:58:21.957 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-15T14:58:21.986 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:58:21.988 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-15T14:58:22.041 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-15T14:58:22.042 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-15T14:58:22.042 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-15T14:58:22.042 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-04-15T14:58:22.044 INFO:tasks.ceph.mon.a:Started 2024-04-15T14:58:22.044 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-15T14:58:22.045 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-15T14:58:22.045 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-04-15T14:58:22.047 INFO:tasks.ceph.mon.c:Started 2024-04-15T14:58:22.047 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-15T14:58:22.047 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-15T14:58:22.047 DEBUG:teuthology.orchestra.run.smithi164:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-04-15T14:58:22.084 INFO:tasks.ceph.mon.b:Started 2024-04-15T14:58:22.084 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-15T14:58:22.084 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-15T14:58:22.085 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-15T14:58:22.087 INFO:tasks.ceph.mgr.y:Started 2024-04-15T14:58:22.087 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-15T14:58:22.087 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-15T14:58:22.089 INFO:tasks.ceph.mgr.x:Started 2024-04-15T14:58:22.089 INFO:tasks.ceph:Setting crush tunables to default 2024-04-15T14:58:22.090 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.193+0000 7f2544e2a640 10 monclient: get_monmap_and_config 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.193+0000 7f2544e2a640 10 monclient: build_initial_monmap 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.193+0000 7f2544e2a640 10 monclient: monmap: 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:58:22.193856+0000 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:58:22.193856+0000 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:22.194 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:22.195 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:22.195 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:22.195 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:22.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.193+0000 7f2544e2a640 1 Processor -- start 2024-04-15T14:58:22.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.193+0000 7f2544e2a640 1 -- start start 2024-04-15T14:58:22.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.193+0000 7f2544e2a640 10 monclient: init 2024-04-15T14:58:22.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:22.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:58:22.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 10 monclient(hunting): picked mon.noname-c con 0x7f25400b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:22.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 10 monclient(hunting): picked mon.noname-a con 0x7f25400b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:22.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 10 monclient(hunting): picked mon.noname-b con 0x7f2540140b30 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:22.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2540146e10 con 0x7f25400b5bb0 2024-04-15T14:58:22.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400aa840 con 0x7f25400b57d0 2024-04-15T14:58:22.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400aa460 con 0x7f2540140b30 2024-04-15T14:58:22.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:22.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f2540140420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:22.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f2544e2a640 10 monclient(hunting): authenticate will time out at 1362.465040s 2024-04-15T14:58:22.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f253ed9d640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f254014ea80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:22.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.194+0000 7f253e59c640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f2540146700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:22.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.395+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f2540140420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:22.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.395+0000 7f253ed9d640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f254014ea80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:22.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.395+0000 7f253e59c640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f2540146700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:22.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.796+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f2540140420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:22.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.796+0000 7f253ed9d640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f254014ea80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:22.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:22.796+0000 7f253e59c640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f2540146700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:23.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:23.597+0000 7f253ed9d640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f254014ea80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:23.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:23.597+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f2540140420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:23.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:23.597+0000 7f253e59c640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f2540146700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 10 monclient(hunting): tick 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 10 monclient(hunting): _check_auth_tickets 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 1 monclient(hunting): continuing hunt 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 10 monclient(hunting): _reopen_session rank -1 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f254014ea80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f2540146700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f2540140420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-a con 0x7f25400b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-b con 0x7f2540140b30 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:25.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-c con 0x7f25400b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:25.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400b2970 con 0x7f25400b5bb0 2024-04-15T14:58:25.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2540146e10 con 0x7f25400b57d0 2024-04-15T14:58:25.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400aa840 con 0x7f2540140b30 2024-04-15T14:58:25.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253cd99640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:25.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253e59c640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f25200056d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:25.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:25.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.194+0000 7f253ed9d640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000c700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:25.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.395+0000 7f253e59c640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f25200056d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:25.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.395+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:25.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.395+0000 7f253ed9d640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000c700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.796+0000 7f253e59c640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f25200056d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.796+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:25.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:25.796+0000 7f253ed9d640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000c700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:26.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:26.597+0000 7f253e59c640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f25200056d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:26.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:26.597+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:26.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:26.597+0000 7f253ed9d640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000c700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 10 monclient(hunting): tick 2024-04-15T14:58:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 10 monclient(hunting): _check_auth_tickets 2024-04-15T14:58:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 1 monclient(hunting): continuing hunt 2024-04-15T14:58:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 10 monclient(hunting): _reopen_session rank -1 2024-04-15T14:58:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T14:58:28.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000c700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f25200056d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-c con 0x7f25400b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-b con 0x7f2540140b30 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-a con 0x7f25400b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400aa460 con 0x7f25400b5bb0 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400b2970 con 0x7f25400b57d0 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2540146e10 con 0x7f2540140b30 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253cd99640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f253ed9d640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f252000f5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.194+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:28.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.195+0000 7f253e59c640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000eed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:28.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.395+0000 7f253ed9d640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f252000f5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:28.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.395+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:28.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.396+0000 7f253e59c640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000eed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:28.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.796+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:28.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.796+0000 7f253ed9d640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f252000f5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:28.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:28.797+0000 7f253e59c640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000eed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:29.039 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:00:06.829 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T14:58:29.351 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:00:07.141 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T14:58:29.475 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:00:07.318 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T14:58:29.488 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:00:07.331 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T14:58:29.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:29.597+0000 7f253ed9d640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f252000f5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6789/0 2024-04-15T14:58:29.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:29.597+0000 7f2537fff640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.38:6790/0 2024-04-15T14:58:29.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:29.598+0000 7f253e59c640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000eed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.164:6789/0 2024-04-15T14:58:29.807 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:00:07.650 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T14:58:29.822 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:00:07.665 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T14:58:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 10 monclient(hunting): tick 2024-04-15T14:58:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 10 monclient(hunting): _check_auth_tickets 2024-04-15T14:58:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 1 monclient(hunting): continuing hunt 2024-04-15T14:58:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 10 monclient(hunting): _reopen_session rank -1 2024-04-15T14:58:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 1 -- >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T14:58:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 1 -- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f252000eed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T14:58:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 1 -- >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f252000f5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-15T14:58:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:58:31.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-a con 0x7f25400b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-b con 0x7f2540140b30 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-c con 0x7f25400b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400aa840 con 0x7f25400b5bb0 2024-04-15T14:58:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400aa460 con 0x7f25400b57d0 2024-04-15T14:58:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400b2970 con 0x7f2540140b30 2024-04-15T14:58:31.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.195+0000 7f253cd99640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.246+0000 7f253ed9d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 0x7f2520008e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:58154/0 (socket says 172.21.15.38:58154) 2024-04-15T14:58:31.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.246+0000 7f253ed9d640 1 -- 172.21.15.38:0/1461247887 learned_addr learned my addr 172.21.15.38:0/1461247887 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:58:31.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.522+0000 7f253e59c640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f252000f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-15T14:58:31.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.522+0000 7f253e59c640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f252000f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-15T14:58:31.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.522+0000 7f253e59c640 1 --1- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 0x7f252000f5e0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-04-15T14:58:31.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.551+0000 7f2537fff640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f252000c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-04-15T14:58:31.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.551+0000 7f2537fff640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f252000c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-15T14:58:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.551+0000 7f2537fff640 1 --1- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 0x7f252000c700 :-1 s=OPENED pgs=2 cs=1 l=1).handle_message read tag failed 2024-04-15T14:58:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.551+0000 7f2537fff640 1 --1- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 0x7f252000c700 :-1 s=OPENED pgs=2 cs=1 l=1).fault on lossy channel, failing 2024-04-15T14:58:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:31.551+0000 7f253dd9b640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.38:6790/0 2024-04-15T14:58:34.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 10 monclient(hunting): tick 2024-04-15T14:58:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 10 monclient(hunting): _check_auth_tickets 2024-04-15T14:58:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 1 monclient(hunting): continuing hunt 2024-04-15T14:58:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 10 monclient(hunting): _reopen_session rank -1 2024-04-15T14:58:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f252000c700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-15T14:58:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f2520008e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f25400b5bb0 legacy=0x7f252000f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:58:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-b con 0x7f2540140b30 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:34.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-a con 0x7f252000ee50 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-c con 0x7f25400b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2540146e10 con 0x7f252000ee50 2024-04-15T14:58:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000f380 con 0x7f25400b57d0 2024-04-15T14:58:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000f5a0 con 0x7f2540140b30 2024-04-15T14:58:34.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:34.195+0000 7f253cd99640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 10 monclient(hunting): tick 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 10 monclient(hunting): _check_auth_tickets 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 1 monclient(hunting): continuing hunt 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 10 monclient(hunting): _reopen_session rank -1 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f252000c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f25400b57d0 legacy=0x7f2520008e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f252000ee50 legacy=0x7f2520005690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-c con 0x7f2520005e00 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-a con 0x7f2520006950 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-b con 0x7f2540140b30 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:37.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000f7c0 con 0x7f2520006950 2024-04-15T14:58:37.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000c700 con 0x7f2520005e00 2024-04-15T14:58:37.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000c920 con 0x7f2540140b30 2024-04-15T14:58:37.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:37.196+0000 7f253cd99640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 10 monclient(hunting): tick 2024-04-15T14:58:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 10 monclient(hunting): _check_auth_tickets 2024-04-15T14:58:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 1 monclient(hunting): continuing hunt 2024-04-15T14:58:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 10 monclient(hunting): _reopen_session rank -1 2024-04-15T14:58:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2540140b30 legacy=0x7f2520008e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f2520005e00 legacy=0x7f2520006240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f2520006950 legacy=0x7f2520010f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-a con 0x7f25200116a0 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-b con 0x7f2520011ba0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-c con 0x7f2520005e00 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000cb40 con 0x7f25200116a0 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2520011040 con 0x7f2520005e00 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2520011260 con 0x7f2520011ba0 2024-04-15T14:58:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:40.196+0000 7f253cd99640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:43.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 10 monclient(hunting): tick 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 10 monclient(hunting): _check_auth_tickets 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 1 monclient(hunting): continuing hunt 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 10 monclient(hunting): _reopen_session rank -1 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2520011ba0 legacy=0x7f252000ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f2520005e00 legacy=0x7f2520006240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f25200116a0 legacy=0x7f2520005690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-b con 0x7f2520008f10 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-a con 0x7f252000ce10 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-c con 0x7f2520005e00 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25200093d0 con 0x7f252000ce10 2024-04-15T14:58:43.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000d240 con 0x7f2520005e00 2024-04-15T14:58:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2520009d10 con 0x7f2520008f10 2024-04-15T14:58:43.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:43.196+0000 7f253cd99640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 10 monclient(hunting): tick 2024-04-15T14:58:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 10 monclient(hunting): _check_auth_tickets 2024-04-15T14:58:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 1 monclient(hunting): continuing hunt 2024-04-15T14:58:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 10 monclient(hunting): _reopen_session rank -1 2024-04-15T14:58:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2520008f10 legacy=0x7f252000d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f2520005e00 legacy=0x7f2520006240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f252000ce10 legacy=0x7f2520009600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:46.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:58:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-c con 0x7f25200058f0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-b con 0x7f2520015fd0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-a con 0x7f252000ce10 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25200056a0 con 0x7f252000ce10 2024-04-15T14:58:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000d5c0 con 0x7f25200058f0 2024-04-15T14:58:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000d790 con 0x7f2520015fd0 2024-04-15T14:58:46.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.197+0000 7f253cd99640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.199+0000 7f253e59c640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f25200058f0 legacy=0x7f2520009ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-04-15T14:58:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.199+0000 7f253e59c640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f25200058f0 legacy=0x7f2520009ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-15T14:58:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.199+0000 7f253e59c640 1 --1- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f25200058f0 0x7f2520009ee0 :-1 s=OPENED pgs=32 cs=1 l=1).handle_message read tag failed 2024-04-15T14:58:46.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.199+0000 7f253e59c640 1 --1- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f25200058f0 0x7f2520009ee0 :-1 s=OPENED pgs=32 cs=1 l=1).fault on lossy channel, failing 2024-04-15T14:58:46.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:46.199+0000 7f253dd9b640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.164:6789/0 2024-04-15T14:58:49.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.196+0000 7f253cd99640 10 monclient(hunting): tick 2024-04-15T14:58:49.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.196+0000 7f253cd99640 10 monclient(hunting): _check_auth_tickets 2024-04-15T14:58:49.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.196+0000 7f253cd99640 1 monclient(hunting): continuing hunt 2024-04-15T14:58:49.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.196+0000 7f253cd99640 10 monclient(hunting): _reopen_session rank -1 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2520015fd0 legacy=0x7f25200163b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f25200058f0 legacy=0x7f2520009ee0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.196+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f252000ce10 legacy=0x7f2520009600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.197+0000 7f253cd99640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.197+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-b con 0x7f2520006220 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.197+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-c con 0x7f25200058f0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.197+0000 7f253cd99640 10 monclient(hunting): picked mon.noname-a con 0x7f252000ce10 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.197+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f252000d960 con 0x7f252000ce10 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.197+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2520006600 con 0x7f25200058f0 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.197+0000 7f253cd99640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2520009ee0 con 0x7f2520006220 2024-04-15T14:58:49.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.197+0000 7f253cd99640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:49.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.476+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127987665 0 0) 0x7f252000d960 con 0x7f252000ce10 2024-04-15T14:58:49.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.476+0000 7f253dd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:58:49.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.476+0000 7f253dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:49.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.476+0000 7f253dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:49.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.476+0000 7f253dd9b640 10 monclient(hunting): my global_id is 4101 2024-04-15T14:58:49.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.476+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f252c003520 con 0x7f252000ce10 2024-04-15T14:58:49.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.503+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156475494 0 0) 0x7f2520006600 con 0x7f25200058f0 2024-04-15T14:58:49.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.503+0000 7f253dd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:58:49.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.503+0000 7f253dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:49.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.503+0000 7f253dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:49.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.503+0000 7f253dd9b640 10 monclient(hunting): my global_id is 4099 2024-04-15T14:58:49.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.503+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f252000d960 con 0x7f25200058f0 2024-04-15T14:58:49.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1716826117 0 0) 0x7f252c003520 con 0x7f252000ce10 2024-04-15T14:58:49.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6790/0 conn(0x7f2520006220 legacy=0x7f2520013f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.164:6789/0 conn(0x7f25200058f0 legacy=0x7f25200163b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 10 monclient: _finish_hunting 0 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 1 monclient: found mon.noname-a 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252000a0b0 con 0x7f252000ce10 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 10 monclient: _finish_auth 0 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 10 monclient: _check_auth_tickets 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2538004330 con 0x7f252000ce10 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f253dd9b640 10 monclient: dump: 2024-04-15T14:58:49.575 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f2544e2a640 5 monclient: authenticate success, global_id 4101 2024-04-15T14:58:49.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.570+0000 7f2544e2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:49.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.610+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2538004590 con 0x7f252000ce10 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.610+0000 7f253dd9b640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.610+0000 7f253dd9b640 1 -- 172.21.15.38:0/1461247887 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f25380049e0 con 0x7f252000ce10 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.610+0000 7f253dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.610+0000 7f253dd9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.610+0000 7f253dd9b640 10 monclient: dump: 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:49.612 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:49.613 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:49.613 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:49.613 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:49.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.610+0000 7f2544e2a640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:49.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.610+0000 7f2544e2a640 4 set_mon_vals no callback set 2024-04-15T14:58:49.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.611+0000 7f2544e2a640 10 monclient: shutdown 2024-04-15T14:58:49.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.611+0000 7f2544e2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:49.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.611+0000 7f2544e2a640 1 -- 172.21.15.38:0/1461247887 >> v1:172.21.15.38:6789/0 conn(0x7f252000ce10 legacy=0x7f2520009600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:49.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.611+0000 7f2544e2a640 1 -- 172.21.15.38:0/1461247887 shutdown_connections 2024-04-15T14:58:49.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.611+0000 7f2544e2a640 1 -- 172.21.15.38:0/1461247887 >> 172.21.15.38:0/1461247887 conn(0x7f2540067790 msgr2=0x7f2540067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.611+0000 7f2544e2a640 1 -- 172.21.15.38:0/1461247887 shutdown_connections 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.611+0000 7f2544e2a640 1 -- 172.21.15.38:0/1461247887 wait complete. 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.612+0000 7f2544e2a640 10 monclient: build_initial_monmap 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.612+0000 7f2544e2a640 10 monclient: monmap: 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:49.616 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 1 librados: starting msgr at 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 1 librados: starting objecter 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 1 Processor -- start 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 1 -- start start 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 1 librados: setting wanted keys 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 1 librados: calling monclient init 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 10 monclient: init 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 10 monclient(hunting): picked mon.noname-c con 0x7f25200058f0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 10 monclient(hunting): picked mon.noname-b con 0x7f2520006220 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 10 monclient(hunting): picked mon.noname-a con 0x7f252000ce10 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400adea0 con 0x7f252000ce10 2024-04-15T14:58:49.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400ae180 con 0x7f2520006220 2024-04-15T14:58:49.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25401d82c0 con 0x7f25200058f0 2024-04-15T14:58:49.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:49.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.613+0000 7f2544e2a640 10 monclient(hunting): authenticate will time out at 1389.884287s 2024-04-15T14:58:49.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.615+0000 7f253e59c640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f25200058f0 0x7f25401d87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:43494/0 (socket says 172.21.15.38:43494) 2024-04-15T14:58:49.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.615+0000 7f253e59c640 1 -- 172.21.15.38:0/1296408495 learned_addr learned my addr 172.21.15.38:0/1296408495 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:58:49.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.615+0000 7f2536ffd640 10 client.?.objecter ms_handle_connect 0x7f25200058f0 2024-04-15T14:58:49.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.615+0000 7f2536ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:49.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.618+0000 7f2536ffd640 10 client.?.objecter ms_handle_connect 0x7f252000ce10 2024-04-15T14:58:49.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.618+0000 7f2536ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:49.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.623+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166676331 0 0) 0x7f252000a0b0 con 0x7f252000ce10 2024-04-15T14:58:49.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.623+0000 7f2536ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:49.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.623+0000 7f2536ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:49.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.623+0000 7f2536ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:49.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.623+0000 7f2536ffd640 10 monclient(hunting): my global_id is 4107 2024-04-15T14:58:49.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.623+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25200114c0 con 0x7f252000ce10 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.639+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1052552646 0 0) 0x7f25200056a0 con 0x7f252000ce10 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.639+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f252000a0b0 con 0x7f252000ce10 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.639+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2538004740 con 0x7f252000ce10 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.639+0000 7f2536ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.639+0000 7f2536ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.639+0000 7f2536ffd640 10 monclient(hunting): dump: 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:49.640 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:49.641 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:49.641 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:49.641 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:49.641 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:49.641 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:49.641 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:49.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.639+0000 7f2536ffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:49.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.645+0000 7f2536ffd640 10 client.?.objecter ms_handle_connect 0x7f2520006220 2024-04-15T14:58:49.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.645+0000 7f2536ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:49.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 255488108 0 0) 0x7f252000a0b0 con 0x7f252000ce10 2024-04-15T14:58:49.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 >> v1:172.21.15.38:6790/0 conn(0x7f25200058f0 legacy=0x7f25401d87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:49.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 >> v1:172.21.15.164:6789/0 conn(0x7f2520006220 legacy=0x7f25400b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:49.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:58:49.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 1 monclient: found mon.a 2024-04-15T14:58:49.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:49.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2540143440 con 0x7f252000ce10 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 10 monclient: _finish_auth 0 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2536ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2544e2a640 5 monclient: authenticate success, global_id 4107 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2544e2a640 10 monclient: _renew_subs 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2544e2a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2544e2a640 1 -- 172.21.15.38:0/1296408495 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f25401d82c0 con 0x7f252000ce10 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2544e2a640 10 client.4107.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2544e2a640 10 monclient: _renew_subs 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2544e2a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2544e2a640 1 -- 172.21.15.38:0/1296408495 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f25400ae180 con 0x7f252000ce10 2024-04-15T14:58:49.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.656+0000 7f2544e2a640 1 librados: init done 2024-04-15T14:58:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.658+0000 7f2544e2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.658+0000 7f2544e2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.658+0000 7f2544e2a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:49.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.658+0000 7f2544e2a640 1 -- 172.21.15.38:0/1296408495 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25400ae180 con 0x7f252000ce10 2024-04-15T14:58:49.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2538004590 con 0x7f252000ce10 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2538004df0 con 0x7f252000ce10 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 10 monclient: dump: 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:49.892 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f2538005360 con 0x7f252000ce10 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f253d59a640 4 set_mon_vals no callback set 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3563447522 0 0) 0x7f2538006ae0 con 0x7f252000ce10 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 10 client.4107.objecter ms_dispatch 0x7f2540000b90 osd_map(1..1 src has 1..1) 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 3 client.4107.objecter handle_osd_map got epochs [1,1] > 0 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 3 client.4107.objecter handle_osd_map decoding full epoch 1 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 20 client.4107.objecter dump_active .. 0 homeless 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7f25200114c0 con 0x7f252000ce10 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:49.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.890+0000 7f2536ffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:49.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.980+0000 7f2544e2a640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-04-15T14:58:49.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.980+0000 7f2544e2a640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-04-15T14:58:49.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.980+0000 7f2544e2a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:49.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:49.980+0000 7f2544e2a640 1 -- 172.21.15.38:0/1296408495 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f25400ae180 con 0x7f252000ce10 2024-04-15T14:58:50.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.139+0000 7f2536ffd640 1 -- 172.21.15.38:0/1296408495 <== mon.0 v1:172.21.15.38:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f2538005730 con 0x7f252000ce10 2024-04-15T14:58:50.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.139+0000 7f2536ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-04-15T14:58:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.139+0000 7f2536ffd640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-04-15T14:58:50.141 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2024-04-15T14:58:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 10 librados: watch_flush enter 2024-04-15T14:58:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 10 librados: watch_flush exit 2024-04-15T14:58:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 20 client.4107.objecter shutdown clearing up homeless session... 2024-04-15T14:58:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 10 client.4107.objecter successfully canceled tick 2024-04-15T14:58:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 10 monclient: shutdown 2024-04-15T14:58:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:50.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 1 -- 172.21.15.38:0/1296408495 >> v1:172.21.15.38:6789/0 conn(0x7f252000ce10 legacy=0x7f25401e3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:50.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 1 -- 172.21.15.38:0/1296408495 shutdown_connections 2024-04-15T14:58:50.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 1 -- 172.21.15.38:0/1296408495 >> 172.21.15.38:0/1296408495 conn(0x7f2540067790 msgr2=0x7f2540067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:50.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 1 -- 172.21.15.38:0/1296408495 shutdown_connections 2024-04-15T14:58:50.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 1 -- 172.21.15.38:0/1296408495 wait complete. 2024-04-15T14:58:50.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:50.140+0000 7f2544e2a640 1 librados: shutdown 2024-04-15T14:58:50.153 INFO:tasks.ceph:check_enable_crimson: False 2024-04-15T14:58:50.153 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-15T14:58:50.154 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:50.154 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-15T14:58:50.187 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:50.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-15T14:58:50.193 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:50.192+0000 7fb9c3db8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T14:58:50.220 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:50.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-15T14:58:50.251 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:50.250+0000 7fb9c3db8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T14:58:50.279 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T14:58:50.279 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-15T14:58:50.348 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:50.348 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-15T14:58:50.377 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:50.377 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-15T14:58:50.415 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:50.413+0000 7fd46902e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T14:58:50.444 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:50.444 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-15T14:58:50.473 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:50.471+0000 7fd46902e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T14:58:50.501 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-15T14:58:50.501 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-15T14:58:50.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new b870e9a9-3e1d-42c1-ba76-36b1ee5978ae 0 2024-04-15T14:58:50.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.711+0000 7f63d81ed640 10 monclient: get_monmap_and_config 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.711+0000 7f63d81ed640 10 monclient: build_initial_monmap 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.711+0000 7f63d81ed640 10 monclient: monmap: 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:58:50.712814+0000 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:58:50.712814+0000 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:50.714 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:50.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.711+0000 7f63d81ed640 1 Processor -- start 2024-04-15T14:58:50.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.711+0000 7f63d81ed640 1 -- start start 2024-04-15T14:58:50.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.711+0000 7f63d81ed640 10 monclient: init 2024-04-15T14:58:50.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:50.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:58:50.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 10 monclient(hunting): picked mon.noname-a con 0x7f63d00b57b0 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:50.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 10 monclient(hunting): picked mon.noname-c con 0x7f63d00b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:50.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 10 monclient(hunting): picked mon.noname-b con 0x7f63d0146d70 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:50.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d0140ca0 con 0x7f63d00b57b0 2024-04-15T14:58:50.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d00ab0e0 con 0x7f63d00b5b90 2024-04-15T14:58:50.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d00b3310 con 0x7f63d0146d70 2024-04-15T14:58:50.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:50.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.712+0000 7f63d81ed640 10 monclient(hunting): authenticate will time out at 1388.841619s 2024-04-15T14:58:50.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.713+0000 7f63d5f89640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f63d00b57b0 0x7f63d0140590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.164:58556/0 (socket says 172.21.15.164:58556) 2024-04-15T14:58:50.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.713+0000 7f63d678a640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f63d0146d70 0x7f63d014ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.164:45920/0 (socket says 172.21.15.164:45920) 2024-04-15T14:58:50.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.713+0000 7f63d5f89640 1 -- 172.21.15.164:0/200602909 learned_addr learned my addr 172.21.15.164:0/200602909 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:50.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.713+0000 7f63d5788640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f63d00b5b90 0x7f63d0146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42464/0 (socket says 172.21.15.164:42464) 2024-04-15T14:58:50.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.715+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1082517071 0 0) 0x7f63d00ab0e0 con 0x7f63d00b5b90 2024-04-15T14:58:50.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.715+0000 7f63d4f87640 10 monclient(hunting): _negotiate 2024-04-15T14:58:50.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.715+0000 7f63d4f87640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:50.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.715+0000 7f63d4f87640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:50.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.715+0000 7f63d4f87640 10 monclient(hunting): my global_id is 4111 2024-04-15T14:58:50.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.715+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63bc003520 con 0x7f63d00b5b90 2024-04-15T14:58:50.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.716+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997819641 0 0) 0x7f63d0140ca0 con 0x7f63d00b57b0 2024-04-15T14:58:50.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.716+0000 7f63d4f87640 10 monclient(hunting): _negotiate 2024-04-15T14:58:50.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.716+0000 7f63d4f87640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:50.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.716+0000 7f63d4f87640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:50.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.716+0000 7f63d4f87640 10 monclient(hunting): my global_id is 4116 2024-04-15T14:58:50.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.716+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d00ab0e0 con 0x7f63d00b57b0 2024-04-15T14:58:50.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3804488675 0 0) 0x7f63bc003520 con 0x7f63d00b5b90 2024-04-15T14:58:50.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 >> v1:172.21.15.38:6790/0 conn(0x7f63d0146d70 legacy=0x7f63d014ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:50.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 >> v1:172.21.15.38:6789/0 conn(0x7f63d00b57b0 legacy=0x7f63d0140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:50.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 10 monclient: _finish_hunting 0 2024-04-15T14:58:50.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 1 monclient: found mon.noname-c 2024-04-15T14:58:50.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:50.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:58:50.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d00aa460 con 0x7f63d00b5b90 2024-04-15T14:58:50.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 10 monclient: _finish_auth 0 2024-04-15T14:58:50.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 10 monclient: _check_auth_tickets 2024-04-15T14:58:50.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:50.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f63cc001610 con 0x7f63d00b5b90 2024-04-15T14:58:50.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:50.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:58:50.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d4f87640 10 monclient: dump: 2024-04-15T14:58:50.725 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:50.725 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:50.725 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:50.725 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:50.725 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:50.726 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:50.726 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:50.726 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:50.726 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:50.726 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:50.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d81ed640 5 monclient: authenticate success, global_id 4111 2024-04-15T14:58:50.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.719+0000 7f63d81ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:50.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.745+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63cc001870 con 0x7f63d00b5b90 2024-04-15T14:58:50.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.745+0000 7f63d4f87640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:50.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.745+0000 7f63d4f87640 1 -- 172.21.15.164:0/200602909 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f63cc001c40 con 0x7f63d00b5b90 2024-04-15T14:58:50.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.745+0000 7f63d81ed640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.745+0000 7f63d81ed640 4 set_mon_vals no callback set 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.745+0000 7f63d4f87640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.745+0000 7f63d4f87640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.745+0000 7f63d4f87640 10 monclient: dump: 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:50.748 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:50.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.746+0000 7f63d81ed640 10 monclient: shutdown 2024-04-15T14:58:50.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.746+0000 7f63d81ed640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:50.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.746+0000 7f63d81ed640 1 -- 172.21.15.164:0/200602909 >> v1:172.21.15.164:6789/0 conn(0x7f63d00b5b90 legacy=0x7f63d0146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:50.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.746+0000 7f63d81ed640 1 -- 172.21.15.164:0/200602909 shutdown_connections 2024-04-15T14:58:50.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.746+0000 7f63d81ed640 1 -- 172.21.15.164:0/200602909 >> 172.21.15.164:0/200602909 conn(0x7f63d0067790 msgr2=0x7f63d0067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:50.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.746+0000 7f63d81ed640 1 -- 172.21.15.164:0/200602909 shutdown_connections 2024-04-15T14:58:50.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.746+0000 7f63d81ed640 1 -- 172.21.15.164:0/200602909 wait complete. 2024-04-15T14:58:50.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.747+0000 7f63d81ed640 10 monclient: build_initial_monmap 2024-04-15T14:58:50.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.747+0000 7f63d81ed640 10 monclient: monmap: 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 0.000000 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:created 0.000000 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 1 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.747+0000 7f63d81ed640 1 librados: starting msgr at 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.747+0000 7f63d81ed640 1 librados: starting objecter 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.748+0000 7f63d81ed640 1 Processor -- start 2024-04-15T14:58:50.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.748+0000 7f63d81ed640 1 -- start start 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.748+0000 7f63d81ed640 1 librados: setting wanted keys 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.748+0000 7f63d81ed640 1 librados: calling monclient init 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.748+0000 7f63d81ed640 10 monclient: init 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.748+0000 7f63d81ed640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.748+0000 7f63d81ed640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d81ed640 10 monclient(hunting): picked mon.noname-b con 0x7f63d00b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d81ed640 10 monclient(hunting): picked mon.noname-a con 0x7f63d00b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d81ed640 10 monclient(hunting): picked mon.noname-c con 0x7f63d0146d70 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d81ed640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d00ae8b0 con 0x7f63d00b5b90 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d81ed640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d00aeb20 con 0x7f63d00b57b0 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d81ed640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d01d5eb0 con 0x7f63d0146d70 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d81ed640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:50.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d81ed640 10 monclient(hunting): authenticate will time out at 1388.878133s 2024-04-15T14:58:50.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d5f89640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f63d00b57b0 0x7f63d01d53a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42480/0 (socket says 172.21.15.164:42480) 2024-04-15T14:58:50.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63d5f89640 1 -- 172.21.15.164:0/380094496 learned_addr learned my addr 172.21.15.164:0/380094496 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:50.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63c67fc640 10 client.?.objecter ms_handle_connect 0x7f63d00b57b0 2024-04-15T14:58:50.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.749+0000 7f63c67fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:50.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.750+0000 7f63c67fc640 10 client.?.objecter ms_handle_connect 0x7f63d00b5b90 2024-04-15T14:58:50.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.750+0000 7f63c67fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:50.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.750+0000 7f63c67fc640 10 client.?.objecter ms_handle_connect 0x7f63d0146d70 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.750+0000 7f63c67fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.751+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094925648 0 0) 0x7f63d00aeb20 con 0x7f63d00b57b0 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.751+0000 7f63c67fc640 10 monclient(hunting): _negotiate 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.751+0000 7f63c67fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.751+0000 7f63c67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.751+0000 7f63c67fc640 10 monclient(hunting): my global_id is 4114 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.751+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b4004eb0 con 0x7f63d00b57b0 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.752+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959252396 0 0) 0x7f63d00ae8b0 con 0x7f63d00b5b90 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.752+0000 7f63c67fc640 10 monclient(hunting): _negotiate 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.752+0000 7f63c67fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.752+0000 7f63c67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.752+0000 7f63c67fc640 10 monclient(hunting): my global_id is 4119 2024-04-15T14:58:50.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.752+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d00aeb20 con 0x7f63d00b5b90 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.758+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1302650977 0 0) 0x7f63d00aeb20 con 0x7f63d00b5b90 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.758+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63d00ae8b0 con 0x7f63d00b5b90 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.758+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f63cc001bc0 con 0x7f63d00b5b90 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.758+0000 7f63c67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.758+0000 7f63c67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.758+0000 7f63c67fc640 10 monclient(hunting): dump: 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:50.760 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:50.761 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:50.761 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:50.761 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:50.761 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:50.761 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:50.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.758+0000 7f63c67fc640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:50.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2979333660 0 0) 0x7f63d00ae8b0 con 0x7f63d00b5b90 2024-04-15T14:58:50.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 >> v1:172.21.15.38:6790/0 conn(0x7f63d0146d70 legacy=0x7f63d01e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 >> v1:172.21.15.164:6789/0 conn(0x7f63d00b57b0 legacy=0x7f63d01d53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 10 monclient: _finish_hunting 0 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 1 monclient: found mon.a 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d00b2890 con 0x7f63d00b5b90 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 10 monclient: _finish_auth 0 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 10 monclient: _check_auth_tickets 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63d81ed640 5 monclient: authenticate success, global_id 4119 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63d81ed640 10 monclient: _renew_subs 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63d81ed640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:50.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63d81ed640 1 -- 172.21.15.164:0/380094496 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63d01d5ab0 con 0x7f63d00b5b90 2024-04-15T14:58:50.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63d81ed640 10 client.4119.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:50.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63d81ed640 10 monclient: _renew_subs 2024-04-15T14:58:50.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63d81ed640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:50.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63d81ed640 1 -- 172.21.15.164:0/380094496 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f63d01d8ea0 con 0x7f63d00b5b90 2024-04-15T14:58:50.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.761+0000 7f63d81ed640 1 librados: init done 2024-04-15T14:58:50.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.762+0000 7f63d81ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:50.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.762+0000 7f63d81ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:50.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.762+0000 7f63d81ed640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:50.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.762+0000 7f63d81ed640 1 -- 172.21.15.164:0/380094496 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d01d5ce0 con 0x7f63d00b5b90 2024-04-15T14:58:50.820 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:50.819+0000 7fb9c3db8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T14:58:50.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.868+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63cc001870 con 0x7f63d00b5b90 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.868+0000 7f63c67fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.868+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f63cc004cd0 con 0x7f63d00b5b90 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.868+0000 7f63c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.868+0000 7f63c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.868+0000 7f63c67fc640 10 monclient: dump: 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:50.871 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:50.872 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:50.872 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:50.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.868+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f63cc005200 con 0x7f63d00b5b90 2024-04-15T14:58:50.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.868+0000 7f63c7fff640 4 set_mon_vals no callback set 2024-04-15T14:58:50.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.869+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (unknown 3049366388 0 0) 0x7f63cc006620 con 0x7f63d00b5b90 2024-04-15T14:58:50.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.869+0000 7f63c67fc640 10 client.4119.objecter ms_dispatch 0x7f63d0000b90 osd_map(2..2 src has 1..2) 2024-04-15T14:58:50.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.869+0000 7f63c67fc640 3 client.4119.objecter handle_osd_map got epochs [2,2] > 0 2024-04-15T14:58:50.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.869+0000 7f63c67fc640 3 client.4119.objecter handle_osd_map decoding full epoch 2 2024-04-15T14:58:50.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.869+0000 7f63c67fc640 20 client.4119.objecter dump_active .. 0 homeless 2024-04-15T14:58:50.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.869+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7f63cc0069b0 con 0x7f63d00b5b90 2024-04-15T14:58:50.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.869+0000 7f63c67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:50.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.869+0000 7f63c67fc640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:50.878 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:50.878+0000 7fb9c3db8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T14:58:50.925 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:50.924+0000 7fb9c3db8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T14:58:50.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.940+0000 7f63d81ed640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b870e9a9-3e1d-42c1-ba76-36b1ee5978ae", "id": 0}] 2024-04-15T14:58:50.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.940+0000 7f63d81ed640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b870e9a9-3e1d-42c1-ba76-36b1ee5978ae", "id": 0}] 2024-04-15T14:58:50.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.940+0000 7f63d81ed640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:50.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:50.940+0000 7f63d81ed640 1 -- 172.21.15.164:0/380094496 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b870e9a9-3e1d-42c1-ba76-36b1ee5978ae", "id": 0} v 0) -- 0x7f63d0077050 con 0x7f63d00b5b90 2024-04-15T14:58:50.981 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:50.979+0000 7fb9c3db8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T14:58:51.027 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:51.026+0000 7fb9c3db8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T14:58:51.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.028+0000 7f63c67fc640 1 -- 172.21.15.164:0/380094496 <== mon.0 v1:172.21.15.38:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b870e9a9-3e1d-42c1-ba76-36b1ee5978ae", "id": 0}]=0 v3) ==== 112+0+2 (unknown 3671898758 0 732707515) 0x7f63cc005670 con 0x7f63d00b5b90 2024-04-15T14:58:51.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.028+0000 7f63c67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b870e9a9-3e1d-42c1-ba76-36b1ee5978ae", "id": 0}] 2024-04-15T14:58:51.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.028+0000 7f63c67fc640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:51.030 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.028+0000 7f63d81ed640 10 librados: watch_flush enter 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.028+0000 7f63d81ed640 10 librados: watch_flush exit 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.028+0000 7f63d81ed640 20 client.4119.objecter shutdown clearing up homeless session... 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.028+0000 7f63d81ed640 10 client.4119.objecter successfully canceled tick 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.029+0000 7f63d81ed640 10 monclient: shutdown 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.029+0000 7f63d81ed640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.029+0000 7f63d81ed640 1 -- 172.21.15.164:0/380094496 >> v1:172.21.15.38:6789/0 conn(0x7f63d00b5b90 legacy=0x7f63d01d85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.029+0000 7f63d81ed640 1 -- 172.21.15.164:0/380094496 shutdown_connections 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.029+0000 7f63d81ed640 1 -- 172.21.15.164:0/380094496 >> 172.21.15.164:0/380094496 conn(0x7f63d0067790 msgr2=0x7f63d013fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.029+0000 7f63d81ed640 1 -- 172.21.15.164:0/380094496 shutdown_connections 2024-04-15T14:58:51.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.029+0000 7f63d81ed640 1 -- 172.21.15.164:0/380094496 wait complete. 2024-04-15T14:58:51.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.029+0000 7f63d81ed640 1 librados: shutdown 2024-04-15T14:58:51.042 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new e06df806-60c1-44b4-bbd4-4f95ab1396c1 1 2024-04-15T14:58:51.058 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.057+0000 7fd46902e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T14:58:51.117 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.115+0000 7fd46902e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.143+0000 7f8a60c31640 10 monclient: get_monmap_and_config 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.143+0000 7f8a60c31640 10 monclient: build_initial_monmap 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.143+0000 7f8a60c31640 10 monclient: monmap: 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:58:51.145613+0000 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:58:51.145613+0000 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:51.146 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:51.147 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.144+0000 7f8a60c31640 1 Processor -- start 2024-04-15T14:58:51.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.144+0000 7f8a60c31640 1 -- start start 2024-04-15T14:58:51.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.144+0000 7f8a60c31640 10 monclient: init 2024-04-15T14:58:51.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:51.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:58:51.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 10 monclient(hunting): picked mon.noname-a con 0x7f8a5c0b57b0 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:51.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 10 monclient(hunting): picked mon.noname-b con 0x7f8a5c0b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:51.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 10 monclient(hunting): picked mon.noname-c con 0x7f8a5c146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c140ca0 con 0x7f8a5c0b57b0 2024-04-15T14:58:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c0ab0e0 con 0x7f8a5c146d70 2024-04-15T14:58:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c0b3310 con 0x7f8a5c0b5b90 2024-04-15T14:58:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a60c31640 10 monclient(hunting): authenticate will time out at 1389.274518s 2024-04-15T14:58:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.145+0000 7f8a5ad9d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f8a5c146d70 0x7f8a5c14ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42490/0 (socket says 172.21.15.164:42490) 2024-04-15T14:58:51.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.146+0000 7f8a5ad9d640 1 -- 172.21.15.164:0/2702264278 learned_addr learned my addr 172.21.15.164:0/2702264278 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:51.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932126690 0 0) 0x7f8a5c0ab0e0 con 0x7f8a5c146d70 2024-04-15T14:58:51.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 10 monclient(hunting): _negotiate 2024-04-15T14:58:51.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:51.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:51.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 10 monclient(hunting): my global_id is 4117 2024-04-15T14:58:51.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a3c003520 con 0x7f8a5c146d70 2024-04-15T14:58:51.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432195443 0 0) 0x7f8a5c140ca0 con 0x7f8a5c0b57b0 2024-04-15T14:58:51.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 10 monclient(hunting): _negotiate 2024-04-15T14:58:51.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:51.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:51.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 10 monclient(hunting): my global_id is 4122 2024-04-15T14:58:51.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.148+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a5c0ab0e0 con 0x7f8a5c0b57b0 2024-04-15T14:58:51.153 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:51.152+0000 7fb9c3db8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3804100399 0 0) 0x7f8a3c003520 con 0x7f8a5c146d70 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 >> v1:172.21.15.38:6790/0 conn(0x7f8a5c0b5b90 legacy=0x7f8a5c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 >> v1:172.21.15.38:6789/0 conn(0x7f8a5c0b57b0 legacy=0x7f8a5c140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 10 monclient: _finish_hunting 0 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 1 monclient: found mon.noname-c 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c0aa460 con 0x7f8a5c146d70 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 10 monclient: _finish_auth 0 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 10 monclient: _check_auth_tickets 2024-04-15T14:58:51.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8a54001990 con 0x7f8a5c146d70 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a59d9b640 10 monclient: dump: 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a60c31640 5 monclient: authenticate success, global_id 4117 2024-04-15T14:58:51.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.151+0000 7f8a60c31640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:51.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a54001bf0 con 0x7f8a5c146d70 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a59d9b640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a59d9b640 1 -- 172.21.15.164:0/2702264278 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8a54001fc0 con 0x7f8a5c146d70 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a60c31640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a60c31640 4 set_mon_vals no callback set 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a59d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a59d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a59d9b640 10 monclient: dump: 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:51.157 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a60c31640 10 monclient: shutdown 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a60c31640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a60c31640 1 -- 172.21.15.164:0/2702264278 >> v1:172.21.15.164:6789/0 conn(0x7f8a5c146d70 legacy=0x7f8a5c14ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a60c31640 1 -- 172.21.15.164:0/2702264278 shutdown_connections 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.154+0000 7f8a60c31640 1 -- 172.21.15.164:0/2702264278 >> 172.21.15.164:0/2702264278 conn(0x7f8a5c067790 msgr2=0x7f8a5c067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.155+0000 7f8a60c31640 1 -- 172.21.15.164:0/2702264278 shutdown_connections 2024-04-15T14:58:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.155+0000 7f8a60c31640 1 -- 172.21.15.164:0/2702264278 wait complete. 2024-04-15T14:58:51.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.155+0000 7f8a60c31640 10 monclient: build_initial_monmap 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.155+0000 7f8a60c31640 10 monclient: monmap: 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 0.000000 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:created 0.000000 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 1 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 1 librados: starting msgr at 2024-04-15T14:58:51.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 1 librados: starting objecter 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 1 Processor -- start 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 1 -- start start 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 1 librados: setting wanted keys 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 1 librados: calling monclient init 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 10 monclient: init 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 10 monclient(hunting): picked mon.noname-c con 0x7f8a5c0b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 10 monclient(hunting): picked mon.noname-a con 0x7f8a5c0b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 10 monclient(hunting): picked mon.noname-b con 0x7f8a5c146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:51.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c0ae950 con 0x7f8a5c0b5b90 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c1d92b0 con 0x7f8a5c146d70 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c145740 con 0x7f8a5c0b57b0 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.156+0000 7f8a60c31640 10 monclient(hunting): authenticate will time out at 1389.285995s 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.157+0000 7f8a5ad9d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f8a5c146d70 0x7f8a5c0ac650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42498/0 (socket says 172.21.15.164:42498) 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.157+0000 7f8a5ad9d640 1 -- 172.21.15.164:0/359709694 learned_addr learned my addr 172.21.15.164:0/359709694 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.157+0000 7f8a52ffd640 10 client.?.objecter ms_handle_connect 0x7f8a5c146d70 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.157+0000 7f8a52ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.158+0000 7f8a52ffd640 10 client.?.objecter ms_handle_connect 0x7f8a5c0b57b0 2024-04-15T14:58:51.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.158+0000 7f8a52ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:51.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.159+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172230166 0 0) 0x7f8a5c1d92b0 con 0x7f8a5c146d70 2024-04-15T14:58:51.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.159+0000 7f8a52ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:51.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.159+0000 7f8a52ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:51.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.159+0000 7f8a52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:51.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.159+0000 7f8a52ffd640 10 monclient(hunting): my global_id is 4120 2024-04-15T14:58:51.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.159+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a40004eb0 con 0x7f8a5c146d70 2024-04-15T14:58:51.165 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.162+0000 7fd46902e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T14:58:51.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.164+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1522172600 0 0) 0x7f8a40004eb0 con 0x7f8a5c146d70 2024-04-15T14:58:51.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.164+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a5c1d92b0 con 0x7f8a5c146d70 2024-04-15T14:58:51.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.164+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8a54002080 con 0x7f8a5c146d70 2024-04-15T14:58:51.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.164+0000 7f8a52ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:51.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.164+0000 7f8a52ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:58:51.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.164+0000 7f8a52ffd640 10 monclient(hunting): dump: 2024-04-15T14:58:51.166 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:51.166 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.166 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.167 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.167 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:51.167 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.167 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:51.167 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:51.167 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:51.167 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.164+0000 7f8a52ffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:51.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1255814498 0 0) 0x7f8a5c1d92b0 con 0x7f8a5c146d70 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 >> v1:172.21.15.38:6790/0 conn(0x7f8a5c0b57b0 legacy=0x7f8a5c1d8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 >> v1:172.21.15.38:6789/0 conn(0x7f8a5c0b5b90 legacy=0x7f8a5c1d5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 1 monclient: found mon.b 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c145910 con 0x7f8a5c146d70 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 10 monclient: _finish_auth 0 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a60c31640 5 monclient: authenticate success, global_id 4120 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a60c31640 10 monclient: _renew_subs 2024-04-15T14:58:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a60c31640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a60c31640 1 -- 172.21.15.164:0/359709694 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c1d5f50 con 0x7f8a5c146d70 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a60c31640 10 client.4120.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a60c31640 10 monclient: _renew_subs 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a60c31640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a60c31640 1 -- 172.21.15.164:0/359709694 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8a5c1d5310 con 0x7f8a5c146d70 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.174+0000 7f8a60c31640 1 librados: init done 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.175+0000 7f8a60c31640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.175+0000 7f8a60c31640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.175+0000 7f8a60c31640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.175+0000 7f8a60c31640 1 -- 172.21.15.164:0/359709694 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c1d6180 con 0x7f8a5c146d70 2024-04-15T14:58:51.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a54001bf0 con 0x7f8a5c146d70 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8a54005000 con 0x7f8a5c146d70 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 10 monclient: dump: 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.199 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f8a54005530 con 0x7f8a5c146d70 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (unknown 388987376 0 0) 0x7f8a54006b00 con 0x7f8a5c146d70 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 10 client.4120.objecter ms_dispatch 0x7f8a5c000b90 osd_map(3..3 src has 1..3) 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 3 client.4120.objecter handle_osd_map got epochs [3,3] > 0 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 3 client.4120.objecter handle_osd_map decoding full epoch 3 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a5959a640 4 set_mon_vals no callback set 2024-04-15T14:58:51.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.196+0000 7f8a52ffd640 20 client.4120.objecter dump_active .. 0 homeless 2024-04-15T14:58:51.221 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.219+0000 7fd46902e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T14:58:51.227 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:51.226+0000 7fb9c3db8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T14:58:51.266 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.264+0000 7fd46902e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T14:58:51.277 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:51.276+0000 7fb9c3db8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T14:58:51.331 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:51.330+0000 7fb9c3db8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T14:58:51.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.369+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7f8a5c145910 con 0x7f8a5c146d70 2024-04-15T14:58:51.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.369+0000 7f8a52ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:51.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.369+0000 7f8a52ffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:51.381 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:51.380+0000 7fb9c3db8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T14:58:51.388 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.386+0000 7fd46902e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-15T14:58:51.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.458+0000 7f8a60c31640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e06df806-60c1-44b4-bbd4-4f95ab1396c1", "id": 1}] 2024-04-15T14:58:51.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.458+0000 7f8a60c31640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e06df806-60c1-44b4-bbd4-4f95ab1396c1", "id": 1}] 2024-04-15T14:58:51.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.458+0000 7f8a60c31640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.458+0000 7f8a60c31640 1 -- 172.21.15.164:0/359709694 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e06df806-60c1-44b4-bbd4-4f95ab1396c1", "id": 1} v 0) -- 0x7f8a5c077050 con 0x7f8a5c146d70 2024-04-15T14:58:51.462 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.461+0000 7fd46902e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T14:58:51.511 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.509+0000 7fd46902e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T14:58:51.565 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.563+0000 7fd46902e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T14:58:51.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.582+0000 7f8a52ffd640 1 -- 172.21.15.164:0/359709694 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e06df806-60c1-44b4-bbd4-4f95ab1396c1", "id": 1}]=0 v4) ==== 112+0+2 (unknown 4125519785 0 940483276) 0x7f8a54005950 con 0x7f8a5c146d70 2024-04-15T14:58:51.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.582+0000 7f8a52ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e06df806-60c1-44b4-bbd4-4f95ab1396c1", "id": 1}] 2024-04-15T14:58:51.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.582+0000 7f8a52ffd640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:51.584 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-04-15T14:58:51.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 10 librados: watch_flush enter 2024-04-15T14:58:51.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 10 librados: watch_flush exit 2024-04-15T14:58:51.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 20 client.4120.objecter shutdown clearing up homeless session... 2024-04-15T14:58:51.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 10 client.4120.objecter successfully canceled tick 2024-04-15T14:58:51.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 10 monclient: shutdown 2024-04-15T14:58:51.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:51.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 1 -- 172.21.15.164:0/359709694 >> v1:172.21.15.164:6789/0 conn(0x7f8a5c146d70 legacy=0x7f8a5c0ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 1 -- 172.21.15.164:0/359709694 shutdown_connections 2024-04-15T14:58:51.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 1 -- 172.21.15.164:0/359709694 >> 172.21.15.164:0/359709694 conn(0x7f8a5c067790 msgr2=0x7f8a5c13f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:51.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 1 -- 172.21.15.164:0/359709694 shutdown_connections 2024-04-15T14:58:51.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 1 -- 172.21.15.164:0/359709694 wait complete. 2024-04-15T14:58:51.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.583+0000 7f8a60c31640 1 librados: shutdown 2024-04-15T14:58:51.595 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new f4979136-ad43-4de0-ada7-929d6dc5b167 2 2024-04-15T14:58:51.616 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:51.614+0000 7fd46902e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T14:58:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.717+0000 7f6ad1c14640 10 monclient: get_monmap_and_config 2024-04-15T14:58:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.717+0000 7f6ad1c14640 10 monclient: build_initial_monmap 2024-04-15T14:58:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.717+0000 7f6ad1c14640 10 monclient: monmap: 2024-04-15T14:58:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:58:51.718877+0000 2024-04-15T14:58:51.719 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:58:51.718877+0000 2024-04-15T14:58:51.720 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:51.720 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.720 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:51.720 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:51.720 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:51.720 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 1 Processor -- start 2024-04-15T14:58:51.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 1 -- start start 2024-04-15T14:58:51.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 10 monclient: init 2024-04-15T14:58:51.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 10 monclient(hunting): picked mon.noname-c con 0x7f6acc0b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 10 monclient(hunting): picked mon.noname-b con 0x7f6acc0b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 10 monclient(hunting): picked mon.noname-a con 0x7f6acc146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc140ca0 con 0x7f6acc146d70 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc0ab0e0 con 0x7f6acc0b57b0 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc0b3310 con 0x7f6acc0b5b90 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.718+0000 7f6ad1c14640 10 monclient(hunting): authenticate will time out at 1389.847867s 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.719+0000 7f6acb7fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6acc0b57b0 0x7f6acc140590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42506/0 (socket says 172.21.15.164:42506) 2024-04-15T14:58:51.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.719+0000 7f6acb7fe640 1 -- 172.21.15.164:0/4195912815 learned_addr learned my addr 172.21.15.164:0/4195912815 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:51.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787681734 0 0) 0x7f6acc0ab0e0 con 0x7f6acc0b57b0 2024-04-15T14:58:51.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:51.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:51.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 10 monclient(hunting): my global_id is 4123 2024-04-15T14:58:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab8003520 con 0x7f6acc0b57b0 2024-04-15T14:58:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458858452 0 0) 0x7f6acc140ca0 con 0x7f6acc146d70 2024-04-15T14:58:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 10 monclient(hunting): my global_id is 4125 2024-04-15T14:58:51.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.721+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6acc0ab0e0 con 0x7f6acc146d70 2024-04-15T14:58:51.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3211536110 0 0) 0x7f6ab8003520 con 0x7f6acc0b57b0 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 >> v1:172.21.15.38:6790/0 conn(0x7f6acc0b5b90 legacy=0x7f6acc146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 >> v1:172.21.15.38:6789/0 conn(0x7f6acc146d70 legacy=0x7f6acc14ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 10 monclient: _finish_hunting 0 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 1 monclient: found mon.noname-c 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc0aa460 con 0x7f6acc0b57b0 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 10 monclient: _finish_auth 0 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 10 monclient: _check_auth_tickets 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6abc001610 con 0x7f6acc0b57b0 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6ad1c14640 5 monclient: authenticate success, global_id 4123 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6ad1c14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:51.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.724+0000 7f6acaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.725+0000 7f6acaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.725+0000 7f6acaffd640 10 monclient: dump: 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.725+0000 7f6ad1c14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:51.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.726+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6abc001870 con 0x7f6acc0b57b0 2024-04-15T14:58:51.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.726+0000 7f6acaffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:51.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.726+0000 7f6acaffd640 1 -- 172.21.15.164:0/4195912815 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6abc001c40 con 0x7f6acc0b57b0 2024-04-15T14:58:51.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.726+0000 7f6acaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:51.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.726+0000 7f6acaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:51.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.726+0000 7f6acaffd640 10 monclient: dump: 2024-04-15T14:58:51.730 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:51.730 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.726+0000 7f6ad1c14640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.726+0000 7f6ad1c14640 4 set_mon_vals no callback set 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.727+0000 7f6ad1c14640 10 monclient: shutdown 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.727+0000 7f6ad1c14640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.727+0000 7f6ad1c14640 1 -- 172.21.15.164:0/4195912815 >> v1:172.21.15.164:6789/0 conn(0x7f6acc0b57b0 legacy=0x7f6acc140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.727+0000 7f6ad1c14640 1 -- 172.21.15.164:0/4195912815 shutdown_connections 2024-04-15T14:58:51.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.727+0000 7f6ad1c14640 1 -- 172.21.15.164:0/4195912815 >> 172.21.15.164:0/4195912815 conn(0x7f6acc067790 msgr2=0x7f6acc067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.727+0000 7f6ad1c14640 1 -- 172.21.15.164:0/4195912815 shutdown_connections 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.727+0000 7f6ad1c14640 1 -- 172.21.15.164:0/4195912815 wait complete. 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.728+0000 7f6ad1c14640 10 monclient: build_initial_monmap 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.728+0000 7f6ad1c14640 10 monclient: monmap: 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 0.000000 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:created 0.000000 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 1 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:51.732 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.728+0000 7f6ad1c14640 1 librados: starting msgr at 2024-04-15T14:58:51.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.728+0000 7f6ad1c14640 1 librados: starting objecter 2024-04-15T14:58:51.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.728+0000 7f6ad1c14640 1 Processor -- start 2024-04-15T14:58:51.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.728+0000 7f6ad1c14640 1 -- start start 2024-04-15T14:58:51.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.728+0000 7f6ad1c14640 1 librados: setting wanted keys 2024-04-15T14:58:51.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.728+0000 7f6ad1c14640 1 librados: calling monclient init 2024-04-15T14:58:51.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.728+0000 7f6ad1c14640 10 monclient: init 2024-04-15T14:58:51.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:51.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:58:51.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 10 monclient(hunting): picked mon.noname-b con 0x7f6acc0b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:51.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 10 monclient(hunting): picked mon.noname-c con 0x7f6acc0b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:51.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 10 monclient(hunting): picked mon.noname-a con 0x7f6acc146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:51.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc137c20 con 0x7f6acc146d70 2024-04-15T14:58:51.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc136620 con 0x7f6acc0b57b0 2024-04-15T14:58:51.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6acc135cf0 con 0x7f6acc0b5b90 2024-04-15T14:58:51.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6ad1c14640 10 monclient(hunting): authenticate will time out at 1389.858389s 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6acb7fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6acc0b57b0 0x7f6acc1d5130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42512/0 (socket says 172.21.15.164:42512) 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.729+0000 7f6acb7fe640 1 -- 172.21.15.164:0/2509732587 learned_addr learned my addr 172.21.15.164:0/2509732587 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.730+0000 7f6ac8ff9640 10 client.?.objecter ms_handle_connect 0x7f6acc0b57b0 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.730+0000 7f6ac8ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.730+0000 7f6ac8ff9640 10 client.?.objecter ms_handle_connect 0x7f6acc146d70 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.730+0000 7f6ac8ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.730+0000 7f6ac8ff9640 10 client.?.objecter ms_handle_connect 0x7f6acc0b5b90 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.730+0000 7f6ac8ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.731+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2629699990 0 0) 0x7f6acc136620 con 0x7f6acc0b57b0 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.731+0000 7f6ac8ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.731+0000 7f6ac8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.731+0000 7f6ac8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:51.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.731+0000 7f6ac8ff9640 10 monclient(hunting): my global_id is 4126 2024-04-15T14:58:51.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.731+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aac004eb0 con 0x7f6acc0b57b0 2024-04-15T14:58:51.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.732+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3601278845 0 0) 0x7f6acc137c20 con 0x7f6acc146d70 2024-04-15T14:58:51.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.732+0000 7f6ac8ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:58:51.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.732+0000 7f6ac8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:51.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.732+0000 7f6ac8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:51.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.732+0000 7f6ac8ff9640 10 monclient(hunting): my global_id is 4128 2024-04-15T14:58:51.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.732+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6acc136620 con 0x7f6acc146d70 2024-04-15T14:58:51.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.736+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2495715875 0 0) 0x7f6aac004eb0 con 0x7f6acc0b57b0 2024-04-15T14:58:51.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.736+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6acc137c20 con 0x7f6acc0b57b0 2024-04-15T14:58:51.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.736+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6abc001c00 con 0x7f6acc0b57b0 2024-04-15T14:58:51.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.736+0000 7f6ac8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:51.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.736+0000 7f6ac8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:58:51.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.736+0000 7f6ac8ff9640 10 monclient(hunting): dump: 2024-04-15T14:58:51.738 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.736+0000 7f6ac8ff9640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:51.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.737+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 771173981 0 0) 0x7f6acc136620 con 0x7f6acc146d70 2024-04-15T14:58:51.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.737+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6aac004eb0 con 0x7f6acc146d70 2024-04-15T14:58:51.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.737+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6ac4001c30 con 0x7f6acc146d70 2024-04-15T14:58:51.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.737+0000 7f6ac8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:51.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.737+0000 7f6ac8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:51.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.737+0000 7f6ac8ff9640 10 monclient(hunting): dump: 2024-04-15T14:58:51.740 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:51.740 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.741 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.741 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.741 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:51.741 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.741 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:51.741 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:51.741 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:51.741 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3410797330 0 0) 0x7f6acc137c20 con 0x7f6acc0b57b0 2024-04-15T14:58:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 >> v1:172.21.15.38:6790/0 conn(0x7f6acc0b5b90 legacy=0x7f6acc1d8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 >> v1:172.21.15.38:6789/0 conn(0x7f6acc146d70 legacy=0x7f6acc13a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 10 monclient: _finish_hunting 0 2024-04-15T14:58:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 1 monclient: found mon.b 2024-04-15T14:58:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc13a800 con 0x7f6acc0b57b0 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 10 monclient: _finish_auth 0 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 10 monclient: _check_auth_tickets 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ac8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ad1c14640 5 monclient: authenticate success, global_id 4126 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ad1c14640 10 monclient: _renew_subs 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ad1c14640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ad1c14640 1 -- 172.21.15.164:0/2509732587 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6acc1369d0 con 0x7f6acc0b57b0 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ad1c14640 10 client.4126.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ad1c14640 10 monclient: _renew_subs 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ad1c14640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ad1c14640 1 -- 172.21.15.164:0/2509732587 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6acc143e40 con 0x7f6acc0b57b0 2024-04-15T14:58:51.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.740+0000 7f6ad1c14640 1 librados: init done 2024-04-15T14:58:51.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.741+0000 7f6ad1c14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:51.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.741+0000 7f6ad1c14640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:51.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.741+0000 7f6ad1c14640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.741+0000 7f6ad1c14640 1 -- 172.21.15.164:0/2509732587 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6acc077050 con 0x7f6acc0b57b0 2024-04-15T14:58:51.786 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:51.785+0000 7fb9c3db8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-15T14:58:51.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6abc001870 con 0x7f6acc0b57b0 2024-04-15T14:58:51.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:51.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6abc004c30 con 0x7f6acc0b57b0 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 10 monclient: dump: 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:51.842 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f6abc005160 con 0x7f6acc0b57b0 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (unknown 3682654199 0 0) 0x7f6abc006460 con 0x7f6acc0b57b0 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 10 client.4126.objecter ms_dispatch 0x7f6acc000b90 osd_map(4..4 src has 1..4) 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6aca7fc640 4 set_mon_vals no callback set 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 3 client.4126.objecter handle_osd_map got epochs [4,4] > 0 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 3 client.4126.objecter handle_osd_map decoding full epoch 4 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 20 client.4126.objecter dump_active .. 0 homeless 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7f6abc018e40 con 0x7f6acc0b57b0 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.839+0000 7f6ac8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:51.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.912+0000 7f6ad1c14640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f4979136-ad43-4de0-ada7-929d6dc5b167", "id": 2}] 2024-04-15T14:58:51.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.912+0000 7f6ad1c14640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f4979136-ad43-4de0-ada7-929d6dc5b167", "id": 2}] 2024-04-15T14:58:51.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.912+0000 7f6ad1c14640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:51.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.912+0000 7f6ad1c14640 1 -- 172.21.15.164:0/2509732587 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd new", "uuid": "f4979136-ad43-4de0-ada7-929d6dc5b167", "id": 2} v 0) -- 0x7f6acc075fb0 con 0x7f6acc0b57b0 2024-04-15T14:58:51.927 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:51.926+0000 7fb9c3db8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T14:58:51.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.990+0000 7f6ac8ff9640 1 -- 172.21.15.164:0/2509732587 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4979136-ad43-4de0-ada7-929d6dc5b167", "id": 2}]=0 v5) ==== 112+0+2 (unknown 811140750 0 216599125) 0x7f6abc006910 con 0x7f6acc0b57b0 2024-04-15T14:58:51.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.990+0000 7f6ac8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f4979136-ad43-4de0-ada7-929d6dc5b167", "id": 2}] 2024-04-15T14:58:51.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.990+0000 7f6ac8ff9640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:51.993 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-04-15T14:58:51.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 10 librados: watch_flush enter 2024-04-15T14:58:51.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 10 librados: watch_flush exit 2024-04-15T14:58:51.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 20 client.4126.objecter shutdown clearing up homeless session... 2024-04-15T14:58:51.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 10 client.4126.objecter successfully canceled tick 2024-04-15T14:58:51.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 10 monclient: shutdown 2024-04-15T14:58:51.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:51.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 1 -- 172.21.15.164:0/2509732587 >> v1:172.21.15.164:6789/0 conn(0x7f6acc0b57b0 legacy=0x7f6acc1d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:51.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 1 -- 172.21.15.164:0/2509732587 shutdown_connections 2024-04-15T14:58:51.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 1 -- 172.21.15.164:0/2509732587 >> 172.21.15.164:0/2509732587 conn(0x7f6acc067790 msgr2=0x7f6acc13ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:51.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 1 -- 172.21.15.164:0/2509732587 shutdown_connections 2024-04-15T14:58:51.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 1 -- 172.21.15.164:0/2509732587 wait complete. 2024-04-15T14:58:51.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:51.991+0000 7f6ad1c14640 1 librados: shutdown 2024-04-15T14:58:52.004 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 593776e0-1477-4717-9384-4a59876dea6b 3 2024-04-15T14:58:52.021 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:52.019+0000 7fd46902e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-15T14:58:52.057 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:52.056+0000 7fb9c3db8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T14:58:52.105 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:52.103+0000 7fb9c3db8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T14:58:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.104+0000 7f6fd9f55640 10 monclient: get_monmap_and_config 2024-04-15T14:58:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.104+0000 7f6fd9f55640 10 monclient: build_initial_monmap 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.104+0000 7f6fd9f55640 10 monclient: monmap: 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:58:52.106456+0000 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:58:52.106456+0000 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:52.107 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.105+0000 7f6fd9f55640 1 Processor -- start 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.105+0000 7f6fd9f55640 1 -- start start 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.105+0000 7f6fd9f55640 10 monclient: init 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 10 monclient(hunting): picked mon.noname-c con 0x7f6fd40b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 10 monclient(hunting): picked mon.noname-b con 0x7f6fd40b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 10 monclient(hunting): picked mon.noname-a con 0x7f6fd4146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd4140ca0 con 0x7f6fd4146d70 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd40ab0e0 con 0x7f6fd40b57b0 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd40b3310 con 0x7f6fd40b5b90 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:52.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.106+0000 7f6fd9f55640 10 monclient(hunting): authenticate will time out at 1390.235583s 2024-04-15T14:58:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.107+0000 7f6fd37fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6fd40b57b0 0x7f6fd4140590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42524/0 (socket says 172.21.15.164:42524) 2024-04-15T14:58:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.107+0000 7f6fd37fe640 1 -- 172.21.15.164:0/2097421517 learned_addr learned my addr 172.21.15.164:0/2097421517 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385408150 0 0) 0x7f6fd40ab0e0 con 0x7f6fd40b57b0 2024-04-15T14:58:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 10 monclient(hunting): my global_id is 4129 2024-04-15T14:58:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fc0003520 con 0x7f6fd40b57b0 2024-04-15T14:58:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931440156 0 0) 0x7f6fd4140ca0 con 0x7f6fd4146d70 2024-04-15T14:58:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 10 monclient(hunting): my global_id is 4131 2024-04-15T14:58:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.109+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd40ab0e0 con 0x7f6fd4146d70 2024-04-15T14:58:52.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2805985782 0 0) 0x7f6fc0003520 con 0x7f6fd40b57b0 2024-04-15T14:58:52.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 >> v1:172.21.15.38:6790/0 conn(0x7f6fd40b5b90 legacy=0x7f6fd4146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 >> v1:172.21.15.38:6789/0 conn(0x7f6fd4146d70 legacy=0x7f6fd414ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 1 monclient: found mon.noname-c 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd40aa460 con 0x7f6fd40b57b0 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 10 monclient: _finish_auth 0 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd9f55640 5 monclient: authenticate success, global_id 4129 2024-04-15T14:58:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6fc4001610 con 0x7f6fd40b57b0 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd9f55640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd2ffd640 10 monclient: dump: 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.112+0000 7f6fd9f55640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:52.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fc4001870 con 0x7f6fd40b57b0 2024-04-15T14:58:52.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd2ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:52.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd9f55640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:52.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd2ffd640 1 -- 172.21.15.164:0/2097421517 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6fc4001c40 con 0x7f6fd40b57b0 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd9f55640 4 set_mon_vals no callback set 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd2ffd640 10 monclient: dump: 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.122 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd9f55640 10 monclient: shutdown 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd9f55640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.114+0000 7f6fd9f55640 1 -- 172.21.15.164:0/2097421517 >> v1:172.21.15.164:6789/0 conn(0x7f6fd40b57b0 legacy=0x7f6fd4140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.115+0000 7f6fd9f55640 1 -- 172.21.15.164:0/2097421517 shutdown_connections 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.115+0000 7f6fd9f55640 1 -- 172.21.15.164:0/2097421517 >> 172.21.15.164:0/2097421517 conn(0x7f6fd4067790 msgr2=0x7f6fd4067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.115+0000 7f6fd9f55640 1 -- 172.21.15.164:0/2097421517 shutdown_connections 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.115+0000 7f6fd9f55640 1 -- 172.21.15.164:0/2097421517 wait complete. 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.115+0000 7f6fd9f55640 10 monclient: build_initial_monmap 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.115+0000 7f6fd9f55640 10 monclient: monmap: 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 0.000000 2024-04-15T14:58:52.123 INFO:teuthology.orchestra.run.smithi164.stderr:created 0.000000 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 1 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.115+0000 7f6fd9f55640 1 librados: starting msgr at 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.115+0000 7f6fd9f55640 1 librados: starting objecter 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 1 Processor -- start 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 1 -- start start 2024-04-15T14:58:52.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 1 librados: setting wanted keys 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 1 librados: calling monclient init 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 10 monclient: init 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 10 monclient(hunting): picked mon.noname-c con 0x7f6fd40b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 10 monclient(hunting): picked mon.noname-a con 0x7f6fd40b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 10 monclient(hunting): picked mon.noname-b con 0x7f6fd4146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd413ce60 con 0x7f6fd40b5b90 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd413d0f0 con 0x7f6fd4146d70 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd40af980 con 0x7f6fd40b57b0 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.116+0000 7f6fd9f55640 10 monclient(hunting): authenticate will time out at 1390.245820s 2024-04-15T14:58:52.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.117+0000 7f6fd3fff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6fd4146d70 0x7f6fd41e2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42536/0 (socket says 172.21.15.164:42536) 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.117+0000 7f6fd3fff640 1 -- 172.21.15.164:0/3479717471 learned_addr learned my addr 172.21.15.164:0/3479717471 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.117+0000 7f6fd0ff9640 10 client.?.objecter ms_handle_connect 0x7f6fd4146d70 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.117+0000 7f6fd0ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.117+0000 7f6fd0ff9640 10 client.?.objecter ms_handle_connect 0x7f6fd40b5b90 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.117+0000 7f6fd0ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.117+0000 7f6fd0ff9640 10 client.?.objecter ms_handle_connect 0x7f6fd40b57b0 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.117+0000 7f6fd0ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613149767 0 0) 0x7f6fd413ce60 con 0x7f6fd40b5b90 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 10 monclient(hunting): my global_id is 4134 2024-04-15T14:58:52.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb4004eb0 con 0x7f6fd40b5b90 2024-04-15T14:58:52.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554219394 0 0) 0x7f6fd413d0f0 con 0x7f6fd4146d70 2024-04-15T14:58:52.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 10 monclient(hunting): my global_id is 4132 2024-04-15T14:58:52.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.119+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd413ce60 con 0x7f6fd4146d70 2024-04-15T14:58:52.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4142630868 0 0) 0x7f6fd413ce60 con 0x7f6fd4146d70 2024-04-15T14:58:52.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fd413d0f0 con 0x7f6fd4146d70 2024-04-15T14:58:52.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6fcc001b90 con 0x7f6fd4146d70 2024-04-15T14:58:52.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:52.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 10 monclient(hunting): dump: 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4242665450 0 0) 0x7f6fb4004eb0 con 0x7f6fd40b5b90 2024-04-15T14:58:52.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fd413ce60 con 0x7f6fd40b5b90 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6fbc0017e0 con 0x7f6fd40b5b90 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.124+0000 7f6fd0ff9640 10 monclient(hunting): dump: 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.130 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.131 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3465948171 0 0) 0x7f6fd413d0f0 con 0x7f6fd4146d70 2024-04-15T14:58:52.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 >> v1:172.21.15.38:6790/0 conn(0x7f6fd40b57b0 legacy=0x7f6fd413c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 >> v1:172.21.15.38:6789/0 conn(0x7f6fd40b5b90 legacy=0x7f6fd413c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 10 monclient: _finish_hunting 0 2024-04-15T14:58:52.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 1 monclient: found mon.b 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd413d5d0 con 0x7f6fd4146d70 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 10 monclient: _finish_auth 0 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 10 monclient: _check_auth_tickets 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd9f55640 5 monclient: authenticate success, global_id 4132 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd9f55640 10 monclient: _renew_subs 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd9f55640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd9f55640 1 -- 172.21.15.164:0/3479717471 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd414fe30 con 0x7f6fd4146d70 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd9f55640 10 client.4132.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd9f55640 10 monclient: _renew_subs 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd9f55640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd9f55640 1 -- 172.21.15.164:0/3479717471 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6fd40b2160 con 0x7f6fd4146d70 2024-04-15T14:58:52.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.127+0000 7f6fd9f55640 1 librados: init done 2024-04-15T14:58:52.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.128+0000 7f6fd9f55640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:52.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.128+0000 7f6fd9f55640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:52.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.128+0000 7f6fd9f55640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.128+0000 7f6fd9f55640 1 -- 172.21.15.164:0/3479717471 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd40af7a0 con 0x7f6fd4146d70 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fcc003990 con 0x7f6fd4146d70 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6fcc003d60 con 0x7f6fd4146d70 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 10 monclient: dump: 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.135 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f6fcc004290 con 0x7f6fd4146d70 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd27fc640 4 set_mon_vals no callback set 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (unknown 2567568794 0 0) 0x7f6fcc006a50 con 0x7f6fd4146d70 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 10 client.4132.objecter ms_dispatch 0x7f6fd4000b90 osd_map(5..5 src has 1..5) 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 3 client.4132.objecter handle_osd_map got epochs [5,5] > 0 2024-04-15T14:58:52.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 3 client.4132.objecter handle_osd_map decoding full epoch 5 2024-04-15T14:58:52.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.132+0000 7f6fd0ff9640 20 client.4132.objecter dump_active .. 0 homeless 2024-04-15T14:58:52.165 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:52.163+0000 7fd46902e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T14:58:52.224 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:52.223+0000 7fb9c3db8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T14:58:52.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.228+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7f6fd40af7a0 con 0x7f6fd4146d70 2024-04-15T14:58:52.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.228+0000 7f6fd0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:52.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.228+0000 7f6fd0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:52.292 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:52.290+0000 7fd46902e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T14:58:52.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.300+0000 7f6fd9f55640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "593776e0-1477-4717-9384-4a59876dea6b", "id": 3}] 2024-04-15T14:58:52.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.300+0000 7f6fd9f55640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "593776e0-1477-4717-9384-4a59876dea6b", "id": 3}] 2024-04-15T14:58:52.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.300+0000 7f6fd9f55640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.300+0000 7f6fd9f55640 1 -- 172.21.15.164:0/3479717471 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd new", "uuid": "593776e0-1477-4717-9384-4a59876dea6b", "id": 3} v 0) -- 0x7f6fd4077050 con 0x7f6fd4146d70 2024-04-15T14:58:52.325 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:52.324+0000 7fb9c3db8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T14:58:52.342 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:52.340+0000 7fd46902e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T14:58:52.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.354+0000 7f6fd0ff9640 1 -- 172.21.15.164:0/3479717471 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "593776e0-1477-4717-9384-4a59876dea6b", "id": 3}]=0 v6) ==== 112+0+2 (unknown 3247911313 0 525046306) 0x7f6fcc0046b0 con 0x7f6fd4146d70 2024-04-15T14:58:52.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.354+0000 7f6fd0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "593776e0-1477-4717-9384-4a59876dea6b", "id": 3}] 2024-04-15T14:58:52.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.354+0000 7f6fd0ff9640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:52.357 INFO:teuthology.orchestra.run.smithi164.stdout:3 2024-04-15T14:58:52.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.355+0000 7f6fd9f55640 10 librados: watch_flush enter 2024-04-15T14:58:52.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.355+0000 7f6fd9f55640 10 librados: watch_flush exit 2024-04-15T14:58:52.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.355+0000 7f6fd9f55640 20 client.4132.objecter shutdown clearing up homeless session... 2024-04-15T14:58:52.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.355+0000 7f6fd9f55640 10 client.4132.objecter successfully canceled tick 2024-04-15T14:58:52.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.355+0000 7f6fd9f55640 10 monclient: shutdown 2024-04-15T14:58:52.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.355+0000 7f6fd9f55640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:52.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.355+0000 7f6fd9f55640 1 -- 172.21.15.164:0/3479717471 >> v1:172.21.15.164:6789/0 conn(0x7f6fd4146d70 legacy=0x7f6fd41e2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.355+0000 7f6fd9f55640 1 -- 172.21.15.164:0/3479717471 shutdown_connections 2024-04-15T14:58:52.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.355+0000 7f6fd9f55640 1 -- 172.21.15.164:0/3479717471 >> 172.21.15.164:0/3479717471 conn(0x7f6fd4067790 msgr2=0x7f6fd413f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:52.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.356+0000 7f6fd9f55640 1 -- 172.21.15.164:0/3479717471 shutdown_connections 2024-04-15T14:58:52.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.356+0000 7f6fd9f55640 1 -- 172.21.15.164:0/3479717471 wait complete. 2024-04-15T14:58:52.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.356+0000 7f6fd9f55640 1 librados: shutdown 2024-04-15T14:58:52.368 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 800a7901-9a0d-4b25-9ae4-1c5d71d12067 4 2024-04-15T14:58:52.466 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:52.463+0000 7fd46902e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T14:58:52.495 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:52.495+0000 7fb9c3db8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T14:58:52.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.510+0000 7ff3a2732640 10 monclient: get_monmap_and_config 2024-04-15T14:58:52.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.510+0000 7ff3a2732640 10 monclient: build_initial_monmap 2024-04-15T14:58:52.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.510+0000 7ff3a2732640 10 monclient: monmap: 2024-04-15T14:58:52.512 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:52.512 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.512 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:58:52.512266+0000 2024-04-15T14:58:52.512 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:58:52.512266+0000 2024-04-15T14:58:52.512 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:52.513 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.513 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:52.513 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:52.513 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:52.513 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.511+0000 7ff3a2732640 1 Processor -- start 2024-04-15T14:58:52.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.511+0000 7ff3a2732640 1 -- start start 2024-04-15T14:58:52.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.511+0000 7ff3a2732640 10 monclient: init 2024-04-15T14:58:52.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 10 monclient(hunting): picked mon.noname-b con 0x7ff39c0b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 10 monclient(hunting): picked mon.noname-c con 0x7ff39c0b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 10 monclient(hunting): picked mon.noname-a con 0x7ff39c146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c140ca0 con 0x7ff39c146d70 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c0ab0e0 con 0x7ff39c0b5b90 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c0b3310 con 0x7ff39c0b57b0 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff3a2732640 10 monclient(hunting): authenticate will time out at 1390.641220s 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff39b7fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff39c0b5b90 0x7ff39c146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42546/0 (socket says 172.21.15.164:42546) 2024-04-15T14:58:52.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.512+0000 7ff39b7fe640 1 -- 172.21.15.164:0/1081820771 learned_addr learned my addr 172.21.15.164:0/1081820771 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:52.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.514+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873360238 0 0) 0x7ff39c140ca0 con 0x7ff39c146d70 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.514+0000 7ff39affd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.514+0000 7ff39affd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.514+0000 7ff39affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.514+0000 7ff39affd640 10 monclient(hunting): my global_id is 4137 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.514+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff388003520 con 0x7ff39c146d70 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.515+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200470932 0 0) 0x7ff39c0ab0e0 con 0x7ff39c0b5b90 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.515+0000 7ff39affd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.515+0000 7ff39affd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.515+0000 7ff39affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.515+0000 7ff39affd640 10 monclient(hunting): my global_id is 4135 2024-04-15T14:58:52.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.515+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff39c140ca0 con 0x7ff39c0b5b90 2024-04-15T14:58:52.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2728550009 0 0) 0x7ff39c140ca0 con 0x7ff39c0b5b90 2024-04-15T14:58:52.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 >> v1:172.21.15.38:6790/0 conn(0x7ff39c0b57b0 legacy=0x7ff39c140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 >> v1:172.21.15.38:6789/0 conn(0x7ff39c146d70 legacy=0x7ff39c14ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 10 monclient: _finish_hunting 0 2024-04-15T14:58:52.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 1 monclient: found mon.noname-c 2024-04-15T14:58:52.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:52.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c0aa460 con 0x7ff39c0b5b90 2024-04-15T14:58:52.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 10 monclient: _finish_auth 0 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 10 monclient: _check_auth_tickets 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff3840015f0 con 0x7ff39c0b5b90 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff39affd640 10 monclient: dump: 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.521 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.522 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff3a2732640 5 monclient: authenticate success, global_id 4135 2024-04-15T14:58:52.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.518+0000 7ff3a2732640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.519+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff384001850 con 0x7ff39c0b5b90 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.519+0000 7ff39affd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.519+0000 7ff39affd640 1 -- 172.21.15.164:0/1081820771 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff384001c20 con 0x7ff39c0b5b90 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.519+0000 7ff39affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.519+0000 7ff39affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.519+0000 7ff39affd640 10 monclient: dump: 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.524 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.519+0000 7ff3a2732640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.519+0000 7ff3a2732640 4 set_mon_vals no callback set 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.520+0000 7ff3a2732640 10 monclient: shutdown 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.520+0000 7ff3a2732640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.520+0000 7ff3a2732640 1 -- 172.21.15.164:0/1081820771 >> v1:172.21.15.164:6789/0 conn(0x7ff39c0b5b90 legacy=0x7ff39c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.520+0000 7ff3a2732640 1 -- 172.21.15.164:0/1081820771 shutdown_connections 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.520+0000 7ff3a2732640 1 -- 172.21.15.164:0/1081820771 >> 172.21.15.164:0/1081820771 conn(0x7ff39c067790 msgr2=0x7ff39c067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.521+0000 7ff3a2732640 1 -- 172.21.15.164:0/1081820771 shutdown_connections 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.521+0000 7ff3a2732640 1 -- 172.21.15.164:0/1081820771 wait complete. 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.521+0000 7ff3a2732640 10 monclient: build_initial_monmap 2024-04-15T14:58:52.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.521+0000 7ff3a2732640 10 monclient: monmap: 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 0.000000 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:created 0.000000 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 1 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 1 librados: starting msgr at 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 1 librados: starting objecter 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 1 Processor -- start 2024-04-15T14:58:52.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 1 -- start start 2024-04-15T14:58:52.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 1 librados: setting wanted keys 2024-04-15T14:58:52.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 1 librados: calling monclient init 2024-04-15T14:58:52.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 10 monclient: init 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 10 monclient(hunting): picked mon.noname-b con 0x7ff39c0b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 10 monclient(hunting): picked mon.noname-c con 0x7ff39c0b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 10 monclient(hunting): picked mon.noname-a con 0x7ff39c146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c137c70 con 0x7ff39c146d70 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c1367a0 con 0x7ff39c0b57b0 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c143c50 con 0x7ff39c0b5b90 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.522+0000 7ff3a2732640 10 monclient(hunting): authenticate will time out at 1390.652062s 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.523+0000 7ff39bfff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff39c0b57b0 0x7ff39c135ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42558/0 (socket says 172.21.15.164:42558) 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.523+0000 7ff39bfff640 1 -- 172.21.15.164:0/1540870229 learned_addr learned my addr 172.21.15.164:0/1540870229 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.523+0000 7ff398ff9640 10 client.?.objecter ms_handle_connect 0x7ff39c146d70 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.523+0000 7ff398ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.523+0000 7ff398ff9640 10 client.?.objecter ms_handle_connect 0x7ff39c0b57b0 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.523+0000 7ff398ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.524+0000 7ff398ff9640 10 client.?.objecter ms_handle_connect 0x7ff39c0b5b90 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.524+0000 7ff398ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547320962 0 0) 0x7ff39c1367a0 con 0x7ff39c0b57b0 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 10 monclient(hunting): my global_id is 4138 2024-04-15T14:58:52.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff37c004eb0 con 0x7ff39c0b57b0 2024-04-15T14:58:52.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489755138 0 0) 0x7ff39c137c70 con 0x7ff39c146d70 2024-04-15T14:58:52.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 10 monclient(hunting): my global_id is 4140 2024-04-15T14:58:52.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.525+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff39c1367a0 con 0x7ff39c146d70 2024-04-15T14:58:52.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2582046413 0 0) 0x7ff37c004eb0 con 0x7ff39c0b57b0 2024-04-15T14:58:52.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff39c137c70 con 0x7ff39c0b57b0 2024-04-15T14:58:52.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff38c001910 con 0x7ff39c0b57b0 2024-04-15T14:58:52.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:52.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:58:52.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 10 monclient(hunting): dump: 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1298332116 0 0) 0x7ff39c1367a0 con 0x7ff39c146d70 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff37c004eb0 con 0x7ff39c146d70 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff394001b50 con 0x7ff39c146d70 2024-04-15T14:58:52.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.530+0000 7ff398ff9640 10 monclient(hunting): dump: 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.534 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 718550696 0 0) 0x7ff39c137c70 con 0x7ff39c0b57b0 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 >> v1:172.21.15.38:6790/0 conn(0x7ff39c0b5b90 legacy=0x7ff39c1d8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 >> v1:172.21.15.38:6789/0 conn(0x7ff39c146d70 legacy=0x7ff39c1d8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 10 monclient: _finish_hunting 0 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 1 monclient: found mon.b 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c143e20 con 0x7ff39c0b57b0 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 10 monclient: _finish_auth 0 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 10 monclient: _check_auth_tickets 2024-04-15T14:58:52.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff398ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:52.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff3a2732640 5 monclient: authenticate success, global_id 4138 2024-04-15T14:58:52.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff3a2732640 10 monclient: _renew_subs 2024-04-15T14:58:52.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff3a2732640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff3a2732640 1 -- 172.21.15.164:0/1540870229 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c1e3fa0 con 0x7ff39c0b57b0 2024-04-15T14:58:52.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff3a2732640 10 client.4138.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:52.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff3a2732640 10 monclient: _renew_subs 2024-04-15T14:58:52.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff3a2732640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff3a2732640 1 -- 172.21.15.164:0/1540870229 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff39c1e4350 con 0x7ff39c0b57b0 2024-04-15T14:58:52.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.533+0000 7ff3a2732640 1 librados: init done 2024-04-15T14:58:52.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.534+0000 7ff3a2732640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:52.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.535+0000 7ff3a2732640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:52.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.535+0000 7ff3a2732640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.535+0000 7ff3a2732640 1 -- 172.21.15.164:0/1540870229 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39c0b82f0 con 0x7ff39c0b57b0 2024-04-15T14:58:52.542 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:52.541+0000 7fb9c3db8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T14:58:52.568 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:52.566+0000 7fd46902e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T14:58:52.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff38c003610 con 0x7ff39c0b57b0 2024-04-15T14:58:52.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff38c003960 con 0x7ff39c0b57b0 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 10 monclient: dump: 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7ff38c003e90 con 0x7ff39c0b57b0 2024-04-15T14:58:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff39a7fc640 4 set_mon_vals no callback set 2024-04-15T14:58:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (unknown 1119821666 0 0) 0x7ff38c006880 con 0x7ff39c0b57b0 2024-04-15T14:58:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 10 client.4138.objecter ms_dispatch 0x7ff39c000b90 osd_map(6..6 src has 1..6) 2024-04-15T14:58:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 3 client.4138.objecter handle_osd_map got epochs [6,6] > 0 2024-04-15T14:58:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 3 client.4138.objecter handle_osd_map decoding full epoch 6 2024-04-15T14:58:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 20 client.4138.objecter dump_active .. 0 homeless 2024-04-15T14:58:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7ff39c0b82f0 con 0x7ff39c0b57b0 2024-04-15T14:58:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:52.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.633+0000 7ff398ff9640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:52.704 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:52.703+0000 7fb9c3db8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T14:58:52.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.706+0000 7ff3a2732640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "800a7901-9a0d-4b25-9ae4-1c5d71d12067", "id": 4}] 2024-04-15T14:58:52.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.706+0000 7ff3a2732640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "800a7901-9a0d-4b25-9ae4-1c5d71d12067", "id": 4}] 2024-04-15T14:58:52.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.706+0000 7ff3a2732640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:52.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.706+0000 7ff3a2732640 1 -- 172.21.15.164:0/1540870229 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd new", "uuid": "800a7901-9a0d-4b25-9ae4-1c5d71d12067", "id": 4} v 0) -- 0x7ff39c077050 con 0x7ff39c0b57b0 2024-04-15T14:58:52.732 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:52.730+0000 7fd46902e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T14:58:52.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.772+0000 7ff398ff9640 1 -- 172.21.15.164:0/1540870229 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "800a7901-9a0d-4b25-9ae4-1c5d71d12067", "id": 4}]=0 v7) ==== 112+0+2 (unknown 959928827 0 1697012583) 0x7ff38c0043b0 con 0x7ff39c0b57b0 2024-04-15T14:58:52.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.772+0000 7ff398ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "800a7901-9a0d-4b25-9ae4-1c5d71d12067", "id": 4}] 2024-04-15T14:58:52.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.772+0000 7ff398ff9640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:52.775 INFO:teuthology.orchestra.run.smithi164.stdout:4 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 10 librados: watch_flush enter 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 10 librados: watch_flush exit 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 20 client.4138.objecter shutdown clearing up homeless session... 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 10 client.4138.objecter successfully canceled tick 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 10 monclient: shutdown 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 1 -- 172.21.15.164:0/1540870229 >> v1:172.21.15.164:6789/0 conn(0x7ff39c0b57b0 legacy=0x7ff39c135ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 1 -- 172.21.15.164:0/1540870229 shutdown_connections 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 1 -- 172.21.15.164:0/1540870229 >> 172.21.15.164:0/1540870229 conn(0x7ff39c067790 msgr2=0x7ff39c0b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 1 -- 172.21.15.164:0/1540870229 shutdown_connections 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 1 -- 172.21.15.164:0/1540870229 wait complete. 2024-04-15T14:58:52.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.773+0000 7ff3a2732640 1 librados: shutdown 2024-04-15T14:58:52.779 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:52.777+0000 7fd46902e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T14:58:52.785 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 7909b57b-d022-4039-9f42-e174c7dd0b74 5 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.885+0000 7f68cf653640 10 monclient: get_monmap_and_config 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.885+0000 7f68cf653640 10 monclient: build_initial_monmap 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.885+0000 7f68cf653640 10 monclient: monmap: 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:58:52.887498+0000 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:58:52.887498+0000 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:52.888 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:52.889 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:52.889 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.886+0000 7f68cf653640 1 Processor -- start 2024-04-15T14:58:52.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.886+0000 7f68cf653640 1 -- start start 2024-04-15T14:58:52.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.886+0000 7f68cf653640 10 monclient: init 2024-04-15T14:58:52.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:52.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:58:52.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 10 monclient(hunting): picked mon.noname-c con 0x7f68c80b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:52.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 10 monclient(hunting): picked mon.noname-b con 0x7f68c80b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:52.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 10 monclient(hunting): picked mon.noname-a con 0x7f68c8146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:52.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c8140ca0 con 0x7f68c8146d70 2024-04-15T14:58:52.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c80ab0e0 con 0x7f68c80b57b0 2024-04-15T14:58:52.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c80b3310 con 0x7f68c80b5b90 2024-04-15T14:58:52.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:52.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cf653640 10 monclient(hunting): authenticate will time out at 1391.016392s 2024-04-15T14:58:52.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.887+0000 7f68cdbf0640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f68c8146d70 0x7f68c814ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.164:58642/0 (socket says 172.21.15.164:58642) 2024-04-15T14:58:52.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.888+0000 7f68cdbf0640 1 -- 172.21.15.164:0/3482859088 learned_addr learned my addr 172.21.15.164:0/3482859088 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:52.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963618774 0 0) 0x7f68c8140ca0 con 0x7f68c8146d70 2024-04-15T14:58:52.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 10 monclient(hunting): my global_id is 4143 2024-04-15T14:58:52.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68b4003520 con 0x7f68c8146d70 2024-04-15T14:58:52.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194267921 0 0) 0x7f68c80ab0e0 con 0x7f68c80b57b0 2024-04-15T14:58:52.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 10 monclient(hunting): my global_id is 4141 2024-04-15T14:58:52.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.890+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68c8140ca0 con 0x7f68c80b57b0 2024-04-15T14:58:52.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1718444591 0 0) 0x7f68b4003520 con 0x7f68c8146d70 2024-04-15T14:58:52.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 >> v1:172.21.15.38:6790/0 conn(0x7f68c80b5b90 legacy=0x7f68c8146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 >> v1:172.21.15.164:6789/0 conn(0x7f68c80b57b0 legacy=0x7f68c8140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 10 monclient: _finish_hunting 0 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 1 monclient: found mon.noname-a 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c80aa460 con 0x7f68c8146d70 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 10 monclient: _finish_auth 0 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 10 monclient: _check_auth_tickets 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f68c0001990 con 0x7f68c8146d70 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68bffff640 10 monclient: dump: 2024-04-15T14:58:52.896 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68cf653640 5 monclient: authenticate success, global_id 4143 2024-04-15T14:58:52.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.893+0000 7f68cf653640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:52.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.895+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68c0001bf0 con 0x7f68c8146d70 2024-04-15T14:58:52.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.895+0000 7f68bffff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:52.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.895+0000 7f68bffff640 1 -- 172.21.15.164:0/3482859088 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f68c0001fc0 con 0x7f68c8146d70 2024-04-15T14:58:52.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.895+0000 7f68cf653640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.895+0000 7f68cf653640 4 set_mon_vals no callback set 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.895+0000 7f68bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.895+0000 7f68bffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.895+0000 7f68bffff640 10 monclient: dump: 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.901 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.896+0000 7f68cf653640 10 monclient: shutdown 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.896+0000 7f68cf653640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.896+0000 7f68cf653640 1 -- 172.21.15.164:0/3482859088 >> v1:172.21.15.38:6789/0 conn(0x7f68c8146d70 legacy=0x7f68c814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.896+0000 7f68cf653640 1 -- 172.21.15.164:0/3482859088 shutdown_connections 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.896+0000 7f68cf653640 1 -- 172.21.15.164:0/3482859088 >> 172.21.15.164:0/3482859088 conn(0x7f68c8067790 msgr2=0x7f68c8067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.896+0000 7f68cf653640 1 -- 172.21.15.164:0/3482859088 shutdown_connections 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.896+0000 7f68cf653640 1 -- 172.21.15.164:0/3482859088 wait complete. 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.896+0000 7f68cf653640 10 monclient: build_initial_monmap 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.896+0000 7f68cf653640 10 monclient: monmap: 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 0.000000 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:created 0.000000 2024-04-15T14:58:52.902 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 1 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 1 librados: starting msgr at 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 1 librados: starting objecter 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 1 Processor -- start 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 1 -- start start 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 1 librados: setting wanted keys 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 1 librados: calling monclient init 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 10 monclient: init 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:58:52.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 10 monclient(hunting): picked mon.noname-a con 0x7f68c80b57b0 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 10 monclient(hunting): picked mon.noname-c con 0x7f68c80b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 10 monclient(hunting): picked mon.noname-b con 0x7f68c8146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c8137e10 con 0x7f68c80b57b0 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c8136300 con 0x7f68c8146d70 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c8136f30 con 0x7f68c80b5b90 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.897+0000 7f68cf653640 10 monclient(hunting): authenticate will time out at 1391.027021s 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.898+0000 7f68cd3ef640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f68c80b57b0 0x7f68c8136820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.164:58650/0 (socket says 172.21.15.164:58650) 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.898+0000 7f68cd3ef640 1 -- 172.21.15.164:0/24321244 learned_addr learned my addr 172.21.15.164:0/24321244 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.898+0000 7f68bdffb640 10 client.?.objecter ms_handle_connect 0x7f68c80b57b0 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.898+0000 7f68bdffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.898+0000 7f68bdffb640 10 client.?.objecter ms_handle_connect 0x7f68c80b5b90 2024-04-15T14:58:52.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.898+0000 7f68bdffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:52.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.900+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590446889 0 0) 0x7f68c8137e10 con 0x7f68c80b57b0 2024-04-15T14:58:52.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.900+0000 7f68bdffb640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.900+0000 7f68bdffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.900+0000 7f68bdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.900+0000 7f68bdffb640 10 monclient(hunting): my global_id is 4146 2024-04-15T14:58:52.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.900+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68ac004eb0 con 0x7f68c80b57b0 2024-04-15T14:58:52.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.900+0000 7f68bdffb640 10 client.?.objecter ms_handle_connect 0x7f68c8146d70 2024-04-15T14:58:52.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.900+0000 7f68bdffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:52.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.902+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839949897 0 0) 0x7f68c8136300 con 0x7f68c8146d70 2024-04-15T14:58:52.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.902+0000 7f68bdffb640 10 monclient(hunting): _negotiate 2024-04-15T14:58:52.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.902+0000 7f68bdffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:52.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.902+0000 7f68bdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:52.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.902+0000 7f68bdffb640 10 monclient(hunting): my global_id is 4144 2024-04-15T14:58:52.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.902+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68c8137e10 con 0x7f68c8146d70 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.905+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1495029197 0 0) 0x7f68ac004eb0 con 0x7f68c80b57b0 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.905+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68c8136300 con 0x7f68c80b57b0 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.905+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f68b8001970 con 0x7f68c80b57b0 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.905+0000 7f68bdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.905+0000 7f68bdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.905+0000 7f68bdffb640 10 monclient(hunting): dump: 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.907 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.908 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.908 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.908 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.908 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.908 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.905+0000 7f68bdffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.907+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 84249836 0 0) 0x7f68c8137e10 con 0x7f68c8146d70 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.907+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68ac004eb0 con 0x7f68c8146d70 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.907+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f68c0001f40 con 0x7f68c8146d70 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.907+0000 7f68bdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.907+0000 7f68bdffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.907+0000 7f68bdffb640 10 monclient(hunting): dump: 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:52.909 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:52.910 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:52.910 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:52.910 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:52.910 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:52.910 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:52.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1387569678 0 0) 0x7f68c8136300 con 0x7f68c80b57b0 2024-04-15T14:58:52.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 >> v1:172.21.15.38:6790/0 conn(0x7f68c80b5b90 legacy=0x7f68c81d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 >> v1:172.21.15.164:6789/0 conn(0x7f68c8146d70 legacy=0x7f68c81d5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:52.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 10 monclient: _finish_hunting 0 2024-04-15T14:58:52.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 1 monclient: found mon.a 2024-04-15T14:58:52.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:52.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c8135c60 con 0x7f68c80b57b0 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 10 monclient: _finish_auth 0 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 10 monclient: _check_auth_tickets 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68cf653640 5 monclient: authenticate success, global_id 4146 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68cf653640 10 monclient: _renew_subs 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68cf653640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.908+0000 7f68cf653640 1 -- 172.21.15.164:0/24321244 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68c81d5f50 con 0x7f68c80b57b0 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.909+0000 7f68cf653640 10 client.4146.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:52.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.909+0000 7f68cf653640 10 monclient: _renew_subs 2024-04-15T14:58:52.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.909+0000 7f68cf653640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:52.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.909+0000 7f68cf653640 1 -- 172.21.15.164:0/24321244 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f68c81d93e0 con 0x7f68c80b57b0 2024-04-15T14:58:52.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.909+0000 7f68cf653640 1 librados: init done 2024-04-15T14:58:52.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.910+0000 7f68cf653640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:52.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.910+0000 7f68cf653640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:52.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.910+0000 7f68cf653640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:52.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:52.910+0000 7f68cf653640 1 -- 172.21.15.164:0/24321244 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c81d6180 con 0x7f68c80b57b0 2024-04-15T14:58:52.947 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:52.945+0000 7fd46902e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.011+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68b8001c50 con 0x7f68c80b57b0 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.011+0000 7f68bdffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.011+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f68b8003a60 con 0x7f68c80b57b0 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.011+0000 7f68bdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.011+0000 7f68bdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.011+0000 7f68bdffb640 10 monclient: dump: 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.013 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.014 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.014 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.014 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.014 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.014 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.014 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.011+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f68b8003f90 con 0x7f68c80b57b0 2024-04-15T14:58:53.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.011+0000 7f68bf7fe640 4 set_mon_vals no callback set 2024-04-15T14:58:53.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.012+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (unknown 163791218 0 0) 0x7f68b80068c0 con 0x7f68c80b57b0 2024-04-15T14:58:53.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.012+0000 7f68bdffb640 10 client.4146.objecter ms_dispatch 0x7f68c8000b90 osd_map(7..7 src has 1..7) 2024-04-15T14:58:53.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.012+0000 7f68bdffb640 3 client.4146.objecter handle_osd_map got epochs [7,7] > 0 2024-04-15T14:58:53.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.012+0000 7f68bdffb640 3 client.4146.objecter handle_osd_map decoding full epoch 7 2024-04-15T14:58:53.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.012+0000 7f68bdffb640 20 client.4146.objecter dump_active .. 0 homeless 2024-04-15T14:58:53.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.012+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7f68b8006340 con 0x7f68c80b57b0 2024-04-15T14:58:53.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.012+0000 7f68bdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:53.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.012+0000 7f68bdffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:53.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.085+0000 7f68cf653640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7909b57b-d022-4039-9f42-e174c7dd0b74", "id": 5}] 2024-04-15T14:58:53.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.085+0000 7f68cf653640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7909b57b-d022-4039-9f42-e174c7dd0b74", "id": 5}] 2024-04-15T14:58:53.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.085+0000 7f68cf653640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:58:53.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.085+0000 7f68cf653640 1 -- 172.21.15.164:0/24321244 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "osd new", "uuid": "7909b57b-d022-4039-9f42-e174c7dd0b74", "id": 5} v 0) -- 0x7f68c8077050 con 0x7f68c80b57b0 2024-04-15T14:58:53.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.114+0000 7f68bdffb640 1 -- 172.21.15.164:0/24321244 <== mon.0 v1:172.21.15.38:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7909b57b-d022-4039-9f42-e174c7dd0b74", "id": 5}]=0 v8) ==== 112+0+2 (unknown 3542246606 0 1988412176) 0x7f68b8006520 con 0x7f68c80b57b0 2024-04-15T14:58:53.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.114+0000 7f68bdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7909b57b-d022-4039-9f42-e174c7dd0b74", "id": 5}] 2024-04-15T14:58:53.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.114+0000 7f68bdffb640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:53.116 INFO:teuthology.orchestra.run.smithi164.stdout:5 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.114+0000 7f68cf653640 10 librados: watch_flush enter 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.114+0000 7f68cf653640 10 librados: watch_flush exit 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.114+0000 7f68cf653640 20 client.4146.objecter shutdown clearing up homeless session... 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.114+0000 7f68cf653640 10 client.4146.objecter successfully canceled tick 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.115+0000 7f68cf653640 10 monclient: shutdown 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.115+0000 7f68cf653640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.115+0000 7f68cf653640 1 -- 172.21.15.164:0/24321244 >> v1:172.21.15.38:6789/0 conn(0x7f68c80b57b0 legacy=0x7f68c8136820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.115+0000 7f68cf653640 1 -- 172.21.15.164:0/24321244 shutdown_connections 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.115+0000 7f68cf653640 1 -- 172.21.15.164:0/24321244 >> 172.21.15.164:0/24321244 conn(0x7f68c8067790 msgr2=0x7f68c813fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.115+0000 7f68cf653640 1 -- 172.21.15.164:0/24321244 shutdown_connections 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.115+0000 7f68cf653640 1 -- 172.21.15.164:0/24321244 wait complete. 2024-04-15T14:58:53.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.115+0000 7f68cf653640 1 librados: shutdown 2024-04-15T14:58:53.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 990d8572-67b1-4e7e-87fd-924316d04870 6 2024-04-15T14:58:53.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.227+0000 7f55252b3640 10 monclient: get_monmap_and_config 2024-04-15T14:58:53.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.227+0000 7f55252b3640 10 monclient: build_initial_monmap 2024-04-15T14:58:53.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.227+0000 7f55252b3640 10 monclient: monmap: 2024-04-15T14:58:53.229 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:53.229 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.230 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:58:53.229242+0000 2024-04-15T14:58:53.230 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:58:53.229242+0000 2024-04-15T14:58:53.230 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:53.230 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.230 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:53.230 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:53.230 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:53.230 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 1 Processor -- start 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 1 -- start start 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 10 monclient: init 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 10 monclient(hunting): picked mon.noname-a con 0x7f5520067790 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 10 monclient(hunting): picked mon.noname-c con 0x7f5520067b70 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 10 monclient(hunting): picked mon.noname-b con 0x7f55200b2140 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55200b11c0 con 0x7f5520067790 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5520073440 con 0x7f5520067b70 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5520143120 con 0x7f55200b2140 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.228+0000 7f55252b3640 10 monclient(hunting): authenticate will time out at 1391.357990s 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.229+0000 7f551e7fc640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f5520067b70 0x7f55200b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42564/0 (socket says 172.21.15.164:42564) 2024-04-15T14:58:53.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.229+0000 7f551e7fc640 1 -- 172.21.15.164:0/2181089522 learned_addr learned my addr 172.21.15.164:0/2181089522 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:53.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.231+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3804867481 0 0) 0x7f5520073440 con 0x7f5520067b70 2024-04-15T14:58:53.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.231+0000 7f551dffb640 10 monclient(hunting): _negotiate 2024-04-15T14:58:53.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.231+0000 7f551dffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:53.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.231+0000 7f551dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:53.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.231+0000 7f551dffb640 10 monclient(hunting): my global_id is 4147 2024-04-15T14:58:53.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.231+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5508003520 con 0x7f5520067b70 2024-04-15T14:58:53.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.232+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051766619 0 0) 0x7f55200b11c0 con 0x7f5520067790 2024-04-15T14:58:53.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.232+0000 7f551dffb640 10 monclient(hunting): _negotiate 2024-04-15T14:58:53.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.232+0000 7f551dffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:53.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.232+0000 7f551dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:53.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.232+0000 7f551dffb640 10 monclient(hunting): my global_id is 4149 2024-04-15T14:58:53.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.232+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5520073440 con 0x7f5520067790 2024-04-15T14:58:53.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 864191870 0 0) 0x7f5508003520 con 0x7f5520067b70 2024-04-15T14:58:53.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 >> v1:172.21.15.38:6790/0 conn(0x7f55200b2140 legacy=0x7f552014e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 >> v1:172.21.15.38:6789/0 conn(0x7f5520067790 legacy=0x7f55201439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 10 monclient: _finish_hunting 0 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 1 monclient: found mon.noname-c 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55201432f0 con 0x7f5520067b70 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 10 monclient: _finish_auth 0 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 10 monclient: _check_auth_tickets 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f5514001610 con 0x7f5520067b70 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f55252b3640 5 monclient: authenticate success, global_id 4147 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f55252b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f551dffb640 10 monclient: dump: 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.239 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.235+0000 7f55252b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:53.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.237+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5514001870 con 0x7f5520067b70 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.237+0000 7f551dffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.237+0000 7f551dffb640 1 -- 172.21.15.164:0/2181089522 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f5514001bc0 con 0x7f5520067b70 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.237+0000 7f551dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.237+0000 7f551dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.237+0000 7f551dffb640 10 monclient: dump: 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.237+0000 7f55252b3640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.237+0000 7f55252b3640 4 set_mon_vals no callback set 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.238+0000 7f55252b3640 10 monclient: shutdown 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.238+0000 7f55252b3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.238+0000 7f55252b3640 1 -- 172.21.15.164:0/2181089522 >> v1:172.21.15.164:6789/0 conn(0x7f5520067b70 legacy=0x7f55200b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.238+0000 7f55252b3640 1 -- 172.21.15.164:0/2181089522 shutdown_connections 2024-04-15T14:58:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.238+0000 7f55252b3640 1 -- 172.21.15.164:0/2181089522 >> 172.21.15.164:0/2181089522 conn(0x7f55200b2530 msgr2=0x7f55200b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:53.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.238+0000 7f55252b3640 1 -- 172.21.15.164:0/2181089522 shutdown_connections 2024-04-15T14:58:53.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.238+0000 7f55252b3640 1 -- 172.21.15.164:0/2181089522 wait complete. 2024-04-15T14:58:53.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.239+0000 7f55252b3640 10 monclient: build_initial_monmap 2024-04-15T14:58:53.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.239+0000 7f55252b3640 10 monclient: monmap: 2024-04-15T14:58:53.246 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:53.246 INFO:teuthology.orchestra.run.smithi164.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:53.246 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 0.000000 2024-04-15T14:58:53.246 INFO:teuthology.orchestra.run.smithi164.stderr:created 0.000000 2024-04-15T14:58:53.246 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:53.246 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 1 2024-04-15T14:58:53.246 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.239+0000 7f55252b3640 1 librados: starting msgr at 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.239+0000 7f55252b3640 1 librados: starting objecter 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 1 Processor -- start 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 1 -- start start 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 1 librados: setting wanted keys 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 1 librados: calling monclient init 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 10 monclient: init 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:53.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 10 monclient(hunting): picked mon.noname-c con 0x7f5520067790 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 10 monclient(hunting): picked mon.noname-b con 0x7f552013aeb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 10 monclient(hunting): picked mon.noname-a con 0x7f5520072100 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552011d610 con 0x7f5520072100 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55201dc040 con 0x7f552013aeb0 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55201dbc60 con 0x7f5520067790 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.240+0000 7f55252b3640 10 monclient(hunting): authenticate will time out at 1391.369820s 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.241+0000 7f551e7fc640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f552013aeb0 0x7f55201dc560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42572/0 (socket says 172.21.15.164:42572) 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.241+0000 7f551e7fc640 1 -- 172.21.15.164:0/3592613836 learned_addr learned my addr 172.21.15.164:0/3592613836 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.241+0000 7f55077fe640 10 client.?.objecter ms_handle_connect 0x7f552013aeb0 2024-04-15T14:58:53.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.241+0000 7f55077fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.241+0000 7f55077fe640 10 client.?.objecter ms_handle_connect 0x7f5520067790 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.241+0000 7f55077fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.242+0000 7f55077fe640 10 client.?.objecter ms_handle_connect 0x7f5520072100 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.242+0000 7f55077fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.243+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368079413 0 0) 0x7f55201dc040 con 0x7f552013aeb0 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.243+0000 7f55077fe640 10 monclient(hunting): _negotiate 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.243+0000 7f55077fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.243+0000 7f55077fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.243+0000 7f55077fe640 10 monclient(hunting): my global_id is 4150 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.243+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f550c004eb0 con 0x7f552013aeb0 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.244+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303432313 0 0) 0x7f552011d610 con 0x7f5520072100 2024-04-15T14:58:53.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.244+0000 7f55077fe640 10 monclient(hunting): _negotiate 2024-04-15T14:58:53.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.244+0000 7f55077fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:53.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.244+0000 7f55077fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:53.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.244+0000 7f55077fe640 10 monclient(hunting): my global_id is 4152 2024-04-15T14:58:53.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.244+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55201dc040 con 0x7f5520072100 2024-04-15T14:58:53.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.247+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1942176026 0 0) 0x7f550c004eb0 con 0x7f552013aeb0 2024-04-15T14:58:53.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.247+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f552011d610 con 0x7f552013aeb0 2024-04-15T14:58:53.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.247+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f5514001c80 con 0x7f552013aeb0 2024-04-15T14:58:53.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.247+0000 7f55077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.247+0000 7f55077fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.247+0000 7f55077fe640 10 monclient(hunting): dump: 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.252 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.247+0000 7f55077fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.249+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3931186070 0 0) 0x7f55201dc040 con 0x7f5520072100 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.249+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f550c004eb0 con 0x7f5520072100 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.249+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f5518001a40 con 0x7f5520072100 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.249+0000 7f55077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.249+0000 7f55077fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.249+0000 7f55077fe640 10 monclient(hunting): dump: 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.253 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.254 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.254 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.254 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.254 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.254 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1169891509 0 0) 0x7f552011d610 con 0x7f552013aeb0 2024-04-15T14:58:53.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 >> v1:172.21.15.38:6790/0 conn(0x7f5520067790 legacy=0x7f55201d8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 >> v1:172.21.15.38:6789/0 conn(0x7f5520072100 legacy=0x7f552013a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 10 monclient: _finish_hunting 0 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 1 monclient: found mon.b 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552013aa40 con 0x7f552013aeb0 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 10 monclient: _finish_auth 0 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 10 monclient: _check_auth_tickets 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55252b3640 5 monclient: authenticate success, global_id 4150 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55252b3640 10 monclient: _renew_subs 2024-04-15T14:58:53.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55252b3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55252b3640 1 -- 172.21.15.164:0/3592613836 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f55201e4fd0 con 0x7f552013aeb0 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55252b3640 10 client.4150.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55252b3640 10 monclient: _renew_subs 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55252b3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55252b3640 1 -- 172.21.15.164:0/3592613836 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f55201e5380 con 0x7f552013aeb0 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.251+0000 7f55252b3640 1 librados: init done 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.252+0000 7f55252b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.252+0000 7f55252b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.252+0000 7f55252b3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.252+0000 7f55252b3640 1 -- 172.21.15.164:0/3592613836 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55201dbe30 con 0x7f552013aeb0 2024-04-15T14:58:53.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5514001810 con 0x7f552013aeb0 2024-04-15T14:58:53.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:53.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f5514004c30 con 0x7f552013aeb0 2024-04-15T14:58:53.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:53.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 10 monclient: dump: 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.354 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f5514005160 con 0x7f552013aeb0 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 2772035145 0 0) 0x7f5514006460 con 0x7f552013aeb0 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 10 client.4150.objecter ms_dispatch 0x7f5520000b90 osd_map(8..8 src has 1..8) 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 3 client.4150.objecter handle_osd_map got epochs [8,8] > 0 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 3 client.4150.objecter handle_osd_map decoding full epoch 8 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f551d7fa640 4 set_mon_vals no callback set 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 20 client.4150.objecter dump_active .. 0 homeless 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7f5514018e40 con 0x7f552013aeb0 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.350+0000 7f55077fe640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:53.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.426+0000 7f55252b3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "990d8572-67b1-4e7e-87fd-924316d04870", "id": 6}] 2024-04-15T14:58:53.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.426+0000 7f55252b3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "990d8572-67b1-4e7e-87fd-924316d04870", "id": 6}] 2024-04-15T14:58:53.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.426+0000 7f55252b3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.426+0000 7f55252b3640 1 -- 172.21.15.164:0/3592613836 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd new", "uuid": "990d8572-67b1-4e7e-87fd-924316d04870", "id": 6} v 0) -- 0x7f5520077050 con 0x7f552013aeb0 2024-04-15T14:58:53.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.519+0000 7f55077fe640 1 -- 172.21.15.164:0/3592613836 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "990d8572-67b1-4e7e-87fd-924316d04870", "id": 6}]=0 v9) ==== 112+0+2 (unknown 1164038659 0 1113811849) 0x7f5514006910 con 0x7f552013aeb0 2024-04-15T14:58:53.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.519+0000 7f55077fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "990d8572-67b1-4e7e-87fd-924316d04870", "id": 6}] 2024-04-15T14:58:53.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.519+0000 7f55077fe640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:53.522 INFO:teuthology.orchestra.run.smithi164.stdout:6 2024-04-15T14:58:53.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.520+0000 7f55252b3640 10 librados: watch_flush enter 2024-04-15T14:58:53.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.520+0000 7f55252b3640 10 librados: watch_flush exit 2024-04-15T14:58:53.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.520+0000 7f55252b3640 20 client.4150.objecter shutdown clearing up homeless session... 2024-04-15T14:58:53.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.520+0000 7f55252b3640 10 client.4150.objecter successfully canceled tick 2024-04-15T14:58:53.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.521+0000 7f55252b3640 10 monclient: shutdown 2024-04-15T14:58:53.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.521+0000 7f55252b3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:53.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.521+0000 7f55252b3640 1 -- 172.21.15.164:0/3592613836 >> v1:172.21.15.164:6789/0 conn(0x7f552013aeb0 legacy=0x7f55201dc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.521+0000 7f55252b3640 1 -- 172.21.15.164:0/3592613836 shutdown_connections 2024-04-15T14:58:53.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.521+0000 7f55252b3640 1 -- 172.21.15.164:0/3592613836 >> 172.21.15.164:0/3592613836 conn(0x7f55200b2530 msgr2=0x7f5520140120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:53.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.521+0000 7f55252b3640 1 -- 172.21.15.164:0/3592613836 shutdown_connections 2024-04-15T14:58:53.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.521+0000 7f55252b3640 1 -- 172.21.15.164:0/3592613836 wait complete. 2024-04-15T14:58:53.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.521+0000 7f55252b3640 1 librados: shutdown 2024-04-15T14:58:53.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 8a80ef70-3374-4016-97d0-79db87381bb5 7 2024-04-15T14:58:53.565 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:53.563+0000 7fb9c3db8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T14:58:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.637+0000 7f0d1ce88640 10 monclient: get_monmap_and_config 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.637+0000 7f0d1ce88640 10 monclient: build_initial_monmap 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.637+0000 7f0d1ce88640 10 monclient: monmap: 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:58:53.638592+0000 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:58:53.638592+0000 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:53.639 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.637+0000 7f0d1ce88640 1 Processor -- start 2024-04-15T14:58:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.637+0000 7f0d1ce88640 1 -- start start 2024-04-15T14:58:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.637+0000 7f0d1ce88640 10 monclient: init 2024-04-15T14:58:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 10 monclient(hunting): picked mon.noname-c con 0x7f0d180b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 10 monclient(hunting): picked mon.noname-b con 0x7f0d180b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 10 monclient(hunting): picked mon.noname-a con 0x7f0d18146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d18140ca0 con 0x7f0d18146d70 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d180ab0e0 con 0x7f0d180b57b0 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d180b3310 con 0x7f0d180b5b90 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1ce88640 10 monclient(hunting): authenticate will time out at 1391.767413s 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1659c640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0d180b57b0 0x7f0d18140590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42580/0 (socket says 172.21.15.164:42580) 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d16d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0d18146d70 0x7f0d1814ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.164:58696/0 (socket says 172.21.15.164:58696) 2024-04-15T14:58:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.638+0000 7f0d1659c640 1 -- 172.21.15.164:0/3414680328 learned_addr learned my addr 172.21.15.164:0/3414680328 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073727418 0 0) 0x7f0d180ab0e0 con 0x7f0d180b57b0 2024-04-15T14:58:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 10 monclient(hunting): _negotiate 2024-04-15T14:58:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 10 monclient(hunting): my global_id is 4153 2024-04-15T14:58:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d04003520 con 0x7f0d180b57b0 2024-04-15T14:58:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2663156542 0 0) 0x7f0d18140ca0 con 0x7f0d18146d70 2024-04-15T14:58:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 10 monclient(hunting): _negotiate 2024-04-15T14:58:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 10 monclient(hunting): my global_id is 4155 2024-04-15T14:58:53.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.641+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d180ab0e0 con 0x7f0d18146d70 2024-04-15T14:58:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3541732367 0 0) 0x7f0d04003520 con 0x7f0d180b57b0 2024-04-15T14:58:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 >> v1:172.21.15.38:6790/0 conn(0x7f0d180b5b90 legacy=0x7f0d18146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:58:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 >> v1:172.21.15.38:6789/0 conn(0x7f0d18146d70 legacy=0x7f0d1814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 10 monclient: _finish_hunting 0 2024-04-15T14:58:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 1 monclient: found mon.noname-c 2024-04-15T14:58:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d180aa460 con 0x7f0d180b57b0 2024-04-15T14:58:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 10 monclient: _finish_auth 0 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 10 monclient: _check_auth_tickets 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0d08001610 con 0x7f0d180b57b0 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d15d9b640 10 monclient: dump: 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.648 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d1ce88640 5 monclient: authenticate success, global_id 4153 2024-04-15T14:58:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.644+0000 7f0d1ce88640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d08001870 con 0x7f0d180b57b0 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d15d9b640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d15d9b640 1 -- 172.21.15.164:0/3414680328 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0d08001c40 con 0x7f0d180b57b0 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d15d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d15d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d15d9b640 10 monclient: dump: 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.650 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d1ce88640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d1ce88640 4 set_mon_vals no callback set 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d1ce88640 10 monclient: shutdown 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d1ce88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d1ce88640 1 -- 172.21.15.164:0/3414680328 >> v1:172.21.15.164:6789/0 conn(0x7f0d180b57b0 legacy=0x7f0d18140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d1ce88640 1 -- 172.21.15.164:0/3414680328 shutdown_connections 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d1ce88640 1 -- 172.21.15.164:0/3414680328 >> 172.21.15.164:0/3414680328 conn(0x7f0d18067790 msgr2=0x7f0d18067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d1ce88640 1 -- 172.21.15.164:0/3414680328 shutdown_connections 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.646+0000 7f0d1ce88640 1 -- 172.21.15.164:0/3414680328 wait complete. 2024-04-15T14:58:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.647+0000 7f0d1ce88640 10 monclient: build_initial_monmap 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.647+0000 7f0d1ce88640 10 monclient: monmap: 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 0 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 0.000000 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:created 0.000000 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 1 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.647+0000 7f0d1ce88640 1 librados: starting msgr at 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 1 librados: starting objecter 2024-04-15T14:58:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 1 Processor -- start 2024-04-15T14:58:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 1 -- start start 2024-04-15T14:58:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 1 librados: setting wanted keys 2024-04-15T14:58:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 1 librados: calling monclient init 2024-04-15T14:58:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 10 monclient: init 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 10 monclient(hunting): picked mon.noname-c con 0x7f0d180b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 10 monclient(hunting): picked mon.noname-a con 0x7f0d180b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 10 monclient(hunting): picked mon.noname-b con 0x7f0d18146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d180ac6f0 con 0x7f0d180b5b90 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d180b23e0 con 0x7f0d18146d70 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d180ad540 con 0x7f0d180b57b0 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.648+0000 7f0d1ce88640 10 monclient(hunting): authenticate will time out at 1391.777837s 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.649+0000 7f0d16d9d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0d18146d70 0x7f0d181e2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:42592/0 (socket says 172.21.15.164:42592) 2024-04-15T14:58:53.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.649+0000 7f0d16d9d640 1 -- 172.21.15.164:0/782151941 learned_addr learned my addr 172.21.15.164:0/782151941 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.649+0000 7f0d0effd640 10 client.?.objecter ms_handle_connect 0x7f0d18146d70 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.649+0000 7f0d0effd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.649+0000 7f0d0effd640 10 client.?.objecter ms_handle_connect 0x7f0d180b5b90 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.649+0000 7f0d0effd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851839216 0 0) 0x7f0d180b23e0 con 0x7f0d18146d70 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 10 monclient(hunting): my global_id is 4156 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cf8004eb0 con 0x7f0d18146d70 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675130831 0 0) 0x7f0d180ac6f0 con 0x7f0d180b5b90 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:53.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 10 monclient(hunting): my global_id is 4158 2024-04-15T14:58:53.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.651+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d180b23e0 con 0x7f0d180b5b90 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.656+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 48379176 0 0) 0x7f0cf8004eb0 con 0x7f0d18146d70 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.656+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d180ac6f0 con 0x7f0d18146d70 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.656+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0d10001b90 con 0x7f0d18146d70 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.656+0000 7f0d0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.656+0000 7f0d0effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.656+0000 7f0d0effd640 10 monclient(hunting): dump: 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.658 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.659 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.659 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.659 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.656+0000 7f0d0effd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:53.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.657+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2476869981 0 0) 0x7f0d180b23e0 con 0x7f0d180b5b90 2024-04-15T14:58:53.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.657+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0cf8004eb0 con 0x7f0d180b5b90 2024-04-15T14:58:53.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.657+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0d000017f0 con 0x7f0d180b5b90 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.657+0000 7f0d0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.657+0000 7f0d0effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.657+0000 7f0d0effd640 10 monclient(hunting): dump: 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.660 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1274485881 0 0) 0x7f0d180ac6f0 con 0x7f0d18146d70 2024-04-15T14:58:53.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 >> v1:172.21.15.38:6790/0 conn(0x7f0d180b57b0 legacy=0x7f0d181db7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 >> v1:172.21.15.38:6789/0 conn(0x7f0d180b5b90 legacy=0x7f0d181dbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 10 monclient: _finish_hunting 0 2024-04-15T14:58:53.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 1 monclient: found mon.b 2024-04-15T14:58:53.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d180acef0 con 0x7f0d18146d70 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 10 monclient: _finish_auth 0 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 10 monclient: _check_auth_tickets 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d1ce88640 5 monclient: authenticate success, global_id 4156 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d1ce88640 10 monclient: _renew_subs 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d1ce88640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d1ce88640 1 -- 172.21.15.164:0/782151941 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0d180ad1a0 con 0x7f0d18146d70 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d1ce88640 10 client.4156.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d1ce88640 10 monclient: _renew_subs 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d1ce88640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d1ce88640 1 -- 172.21.15.164:0/782151941 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0d18143f80 con 0x7f0d18146d70 2024-04-15T14:58:53.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.659+0000 7f0d1ce88640 1 librados: init done 2024-04-15T14:58:53.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.660+0000 7f0d1ce88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:53.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.660+0000 7f0d1ce88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:53.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.660+0000 7f0d1ce88640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.660+0000 7f0d1ce88640 1 -- 172.21.15.164:0/782151941 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d18077050 con 0x7f0d18146d70 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d10004b60 con 0x7f0d18146d70 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0d10004eb0 con 0x7f0d18146d70 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 10 monclient: dump: 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:epoch 1 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:53.760 INFO:teuthology.orchestra.run.smithi164.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:election_strategy: 3 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f0d100053e0 con 0x7f0d18146d70 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d1559a640 4 set_mon_vals no callback set 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (unknown 2007959125 0 0) 0x7f0d10006c10 con 0x7f0d18146d70 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 10 client.4156.objecter ms_dispatch 0x7f0d18000b90 osd_map(9..9 src has 1..9) 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 3 client.4156.objecter handle_osd_map got epochs [9,9] > 0 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 3 client.4156.objecter handle_osd_map decoding full epoch 9 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 20 client.4156.objecter dump_active .. 0 homeless 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7f0d10007030 con 0x7f0d18146d70 2024-04-15T14:58:53.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:53.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.757+0000 7f0d0effd640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:53.793 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:53.791+0000 7fd46902e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T14:58:53.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.830+0000 7f0d1ce88640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8a80ef70-3374-4016-97d0-79db87381bb5", "id": 7}] 2024-04-15T14:58:53.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.830+0000 7f0d1ce88640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8a80ef70-3374-4016-97d0-79db87381bb5", "id": 7}] 2024-04-15T14:58:53.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.830+0000 7f0d1ce88640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:53.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.830+0000 7f0d1ce88640 1 -- 172.21.15.164:0/782151941 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8a80ef70-3374-4016-97d0-79db87381bb5", "id": 7} v 0) -- 0x7f0d18075fb0 con 0x7f0d18146d70 2024-04-15T14:58:53.859 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:53.857+0000 7fb9c3db8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T14:58:53.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.886+0000 7f0d0effd640 1 -- 172.21.15.164:0/782151941 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a80ef70-3374-4016-97d0-79db87381bb5", "id": 7}]=0 v10) ==== 112+0+2 (unknown 1983791439 0 1371665406) 0x7f0d10006640 con 0x7f0d18146d70 2024-04-15T14:58:53.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.886+0000 7f0d0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8a80ef70-3374-4016-97d0-79db87381bb5", "id": 7}] 2024-04-15T14:58:53.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.886+0000 7f0d0effd640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:53.889 INFO:teuthology.orchestra.run.smithi164.stdout:7 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.886+0000 7f0d1ce88640 10 librados: watch_flush enter 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 10 librados: watch_flush exit 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 20 client.4156.objecter shutdown clearing up homeless session... 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 10 client.4156.objecter successfully canceled tick 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 10 monclient: shutdown 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 1 -- 172.21.15.164:0/782151941 >> v1:172.21.15.164:6789/0 conn(0x7f0d18146d70 legacy=0x7f0d181e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 1 -- 172.21.15.164:0/782151941 shutdown_connections 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 1 -- 172.21.15.164:0/782151941 >> 172.21.15.164:0/782151941 conn(0x7f0d18067790 msgr2=0x7f0d180b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 1 -- 172.21.15.164:0/782151941 shutdown_connections 2024-04-15T14:58:53.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 1 -- 172.21.15.164:0/782151941 wait complete. 2024-04-15T14:58:53.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-15T14:58:53.887+0000 7f0d1ce88640 1 librados: shutdown 2024-04-15T14:58:53.899 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T14:58:53.900 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-15T14:58:53.900 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2024-04-15T14:58:53.902 INFO:tasks.ceph.osd.0:Started 2024-04-15T14:58:53.902 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T14:58:53.902 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-15T14:58:53.902 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2024-04-15T14:58:53.904 INFO:tasks.ceph.osd.1:Started 2024-04-15T14:58:53.905 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T14:58:53.905 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-15T14:58:53.906 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2024-04-15T14:58:53.908 INFO:tasks.ceph.osd.2:Started 2024-04-15T14:58:53.908 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T14:58:53.908 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-15T14:58:53.908 DEBUG:teuthology.orchestra.run.smithi038:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2024-04-15T14:58:53.911 INFO:tasks.ceph.osd.3:Started 2024-04-15T14:58:53.911 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T14:58:53.911 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-15T14:58:53.911 DEBUG:teuthology.orchestra.run.smithi164:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2024-04-15T14:58:53.913 INFO:tasks.ceph.osd.4:Started 2024-04-15T14:58:53.913 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T14:58:53.913 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-15T14:58:53.913 DEBUG:teuthology.orchestra.run.smithi164:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2024-04-15T14:58:53.916 INFO:tasks.ceph.osd.5:Started 2024-04-15T14:58:53.916 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T14:58:53.916 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-15T14:58:53.917 DEBUG:teuthology.orchestra.run.smithi164:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2024-04-15T14:58:53.918 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:53.915+0000 7fb9c3db8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T14:58:53.918 INFO:tasks.ceph.osd.6:Started 2024-04-15T14:58:53.919 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-15T14:58:53.919 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-15T14:58:53.919 DEBUG:teuthology.orchestra.run.smithi164:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2024-04-15T14:58:53.921 INFO:tasks.ceph.osd.7:Started 2024-04-15T14:58:53.921 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T14:58:54.074 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.072+0000 7fae46a21640 10 monclient: get_monmap_and_config 2024-04-15T14:58:54.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.072+0000 7fae46a21640 10 monclient: build_initial_monmap 2024-04-15T14:58:54.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.072+0000 7fae46a21640 10 monclient: monmap: 2024-04-15T14:58:54.078 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:58:54.078 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:54.078 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:58:54.073861+0000 2024-04-15T14:58:54.078 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:58:54.073861+0000 2024-04-15T14:58:54.079 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:54.079 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:54.079 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:54.079 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:54.079 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:54.079 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:54.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.073+0000 7fae46a21640 1 Processor -- start 2024-04-15T14:58:54.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.073+0000 7fae46a21640 1 -- start start 2024-04-15T14:58:54.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.073+0000 7fae46a21640 10 monclient: init 2024-04-15T14:58:54.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:54.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:58:54.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 10 monclient(hunting): picked mon.noname-b con 0x7fae400b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:54.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 10 monclient(hunting): picked mon.noname-a con 0x7fae400b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:54.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 10 monclient(hunting): picked mon.noname-c con 0x7fae40146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:54.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae40140ca0 con 0x7fae400b5b90 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae400ab0e0 con 0x7fae40146d70 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae400b3310 con 0x7fae400b57b0 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.074+0000 7fae46a21640 10 monclient(hunting): authenticate will time out at 1394.345775s 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.075+0000 7fae3f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fae400b5b90 0x7fae40146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50864/0 (socket says 172.21.15.38:50864) 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.075+0000 7fae3f7fe640 1 -- 172.21.15.38:0/4167724945 learned_addr learned my addr 172.21.15.38:0/4167724945 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944972508 0 0) 0x7fae400ab0e0 con 0x7fae40146d70 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 10 monclient(hunting): my global_id is 4159 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae28003520 con 0x7fae40146d70 2024-04-15T14:58:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210930030 0 0) 0x7fae40140ca0 con 0x7fae400b5b90 2024-04-15T14:58:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 10 monclient(hunting): _negotiate 2024-04-15T14:58:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 10 monclient(hunting): my global_id is 4161 2024-04-15T14:58:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.079+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae400ab0e0 con 0x7fae400b5b90 2024-04-15T14:58:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.083+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1297326072 0 0) 0x7fae400ab0e0 con 0x7fae400b5b90 2024-04-15T14:58:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.083+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 >> v1:172.21.15.38:6790/0 conn(0x7fae400b57b0 legacy=0x7fae40140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:58:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.083+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 >> v1:172.21.15.164:6789/0 conn(0x7fae40146d70 legacy=0x7fae4014ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.083+0000 7fae3effd640 10 monclient: _finish_hunting 0 2024-04-15T14:58:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.083+0000 7fae3effd640 1 monclient: found mon.noname-a 2024-04-15T14:58:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.083+0000 7fae3effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae3effd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T14:58:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae400aa460 con 0x7fae400b5b90 2024-04-15T14:58:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae3effd640 10 monclient: _finish_auth 0 2024-04-15T14:58:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae3effd640 10 monclient: _check_auth_tickets 2024-04-15T14:58:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae3effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae46a21640 5 monclient: authenticate success, global_id 4161 2024-04-15T14:58:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae46a21640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fae340015f0 con 0x7fae400b5b90 2024-04-15T14:58:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae3effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:58:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae3effd640 10 monclient: dump: 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:54.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.084+0000 7fae46a21640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.087+0000 7fae3effd640 1 -- 172.21.15.38:0/4167724945 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae34001910 con 0x7fae400b5b90 2024-04-15T14:58:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.087+0000 7fae3effd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.087+0000 7fae46a21640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.087+0000 7fae46a21640 4 set_mon_vals no callback set 2024-04-15T14:58:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.087+0000 7fae46a21640 10 monclient: shutdown 2024-04-15T14:58:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.087+0000 7fae46a21640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.087+0000 7fae46a21640 1 -- 172.21.15.38:0/4167724945 >> v1:172.21.15.38:6789/0 conn(0x7fae400b5b90 legacy=0x7fae40146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.088+0000 7fae46a21640 1 -- 172.21.15.38:0/4167724945 shutdown_connections 2024-04-15T14:58:54.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.088+0000 7fae46a21640 1 -- 172.21.15.38:0/4167724945 >> 172.21.15.38:0/4167724945 conn(0x7fae40067790 msgr2=0x7fae40067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.088+0000 7fae46a21640 1 -- 172.21.15.38:0/4167724945 shutdown_connections 2024-04-15T14:58:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.089+0000 7fae46a21640 1 -- 172.21.15.38:0/4167724945 wait complete. 2024-04-15T14:58:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.090+0000 7fae46a21640 10 monclient: build_initial_monmap 2024-04-15T14:58:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.090+0000 7fae46a21640 10 monclient: monmap: 2024-04-15T14:58:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:58:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:58:54.093 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:58:54.093 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:54.093 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:58:54.093 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:54.093 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:54.093 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:54.093 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.091+0000 7fae46a21640 1 librados: starting msgr at 2024-04-15T14:58:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.091+0000 7fae46a21640 1 librados: starting objecter 2024-04-15T14:58:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.091+0000 7fae46a21640 1 Processor -- start 2024-04-15T14:58:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.091+0000 7fae46a21640 1 -- start start 2024-04-15T14:58:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.091+0000 7fae46a21640 1 librados: setting wanted keys 2024-04-15T14:58:54.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.091+0000 7fae46a21640 1 librados: calling monclient init 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.091+0000 7fae46a21640 10 monclient: init 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.092+0000 7fae46a21640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.092+0000 7fae46a21640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.092+0000 7fae46a21640 10 monclient(hunting): picked mon.noname-c con 0x7fae400b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.092+0000 7fae46a21640 10 monclient(hunting): picked mon.noname-a con 0x7fae400b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.092+0000 7fae46a21640 10 monclient(hunting): picked mon.noname-b con 0x7fae40146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.092+0000 7fae46a21640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae400af980 con 0x7fae400b5b90 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.093+0000 7fae46a21640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae400afc60 con 0x7fae40146d70 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.093+0000 7fae46a21640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae401dc160 con 0x7fae400b57b0 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.093+0000 7fae46a21640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.093+0000 7fae46a21640 10 monclient(hunting): authenticate will time out at 1394.364720s 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.093+0000 7fae3f7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fae400b5b90 0x7fae400b24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50866/0 (socket says 172.21.15.38:50866) 2024-04-15T14:58:54.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.093+0000 7fae3f7fe640 1 -- 172.21.15.38:0/1331839672 learned_addr learned my addr 172.21.15.38:0/1331839672 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:58:54.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.094+0000 7fae3cff9640 10 client.?.objecter ms_handle_connect 0x7fae400b5b90 2024-04-15T14:58:54.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.094+0000 7fae3cff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:54.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.094+0000 7fae3cff9640 10 client.?.objecter ms_handle_connect 0x7fae40146d70 2024-04-15T14:58:54.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.094+0000 7fae3cff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:54.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.096+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466734797 0 0) 0x7fae400af980 con 0x7fae400b5b90 2024-04-15T14:58:54.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.096+0000 7fae3cff9640 10 monclient(hunting): _negotiate 2024-04-15T14:58:54.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.096+0000 7fae3cff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:54.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.096+0000 7fae3cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:54.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.096+0000 7fae3cff9640 10 monclient(hunting): my global_id is 4164 2024-04-15T14:58:54.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.096+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae2c004eb0 con 0x7fae400b5b90 2024-04-15T14:58:54.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.097+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3934343315 0 0) 0x7fae400afc60 con 0x7fae40146d70 2024-04-15T14:58:54.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.097+0000 7fae3cff9640 10 monclient(hunting): _negotiate 2024-04-15T14:58:54.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.097+0000 7fae3cff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:54.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.097+0000 7fae3cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:54.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.097+0000 7fae3cff9640 10 monclient(hunting): my global_id is 4162 2024-04-15T14:58:54.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.097+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae2c005210 con 0x7fae40146d70 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.106+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2863778049 0 0) 0x7fae2c005210 con 0x7fae40146d70 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.106+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae400afc60 con 0x7fae40146d70 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.106+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fae38001b50 con 0x7fae40146d70 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.106+0000 7fae3cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.106+0000 7fae3cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.106+0000 7fae3cff9640 10 monclient(hunting): dump: 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:54.108 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:54.109 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:54.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.106+0000 7fae3cff9640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:54.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.107+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 392187025 0 0) 0x7fae2c004eb0 con 0x7fae400b5b90 2024-04-15T14:58:54.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.107+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae2c005210 con 0x7fae400b5b90 2024-04-15T14:58:54.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.107+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fae34004b40 con 0x7fae400b5b90 2024-04-15T14:58:54.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.107+0000 7fae3cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:54.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.107+0000 7fae3cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:58:54.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.107+0000 7fae3cff9640 10 monclient(hunting): dump: 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:54.111 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1179397407 0 0) 0x7fae400afc60 con 0x7fae40146d70 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 >> v1:172.21.15.38:6790/0 conn(0x7fae400b57b0 legacy=0x7fae401db940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 >> v1:172.21.15.38:6789/0 conn(0x7fae400b5b90 legacy=0x7fae400b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 10 monclient: _finish_hunting 0 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 1 monclient: found mon.b 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae400b3170 con 0x7fae40146d70 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 10 monclient: _finish_auth 0 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 10 monclient: _check_auth_tickets 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae3cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae46a21640 5 monclient: authenticate success, global_id 4162 2024-04-15T14:58:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae46a21640 10 monclient: _renew_subs 2024-04-15T14:58:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae46a21640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae46a21640 1 -- 172.21.15.38:0/1331839672 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae400b3460 con 0x7fae40146d70 2024-04-15T14:58:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae46a21640 10 client.4162.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae46a21640 10 monclient: _renew_subs 2024-04-15T14:58:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae46a21640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae46a21640 1 -- 172.21.15.38:0/1331839672 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fae400b2dc0 con 0x7fae40146d70 2024-04-15T14:58:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.112+0000 7fae46a21640 1 librados: init done 2024-04-15T14:58:54.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.113+0000 7fae46a21640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:54.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.113+0000 7fae46a21640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:54.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.113+0000 7fae46a21640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:54.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.113+0000 7fae46a21640 1 -- 172.21.15.38:0/1331839672 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae40077050 con 0x7fae40146d70 2024-04-15T14:58:54.130 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:54.128+0000 7fb9c3db8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T14:58:54.172 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:54.170+0000 7fd46902e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T14:58:54.259 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:54.257+0000 7fd46902e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T14:58:54.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae38002060 con 0x7fae40146d70 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fae38003b30 con 0x7fae40146d70 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 10 monclient: dump: 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:54.286 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fae38004060 con 0x7fae40146d70 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 734170696 0 0) 0x7fae380059e0 con 0x7fae40146d70 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 10 client.4162.objecter ms_dispatch 0x7fae40000b90 osd_map(10..10 src has 1..10) 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 3 client.4162.objecter handle_osd_map got epochs [10,10] > 0 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 3 client.4162.objecter handle_osd_map decoding full epoch 10 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3cff9640 20 client.4162.objecter dump_active .. 0 homeless 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.283+0000 7fae3e7fc640 4 set_mon_vals no callback set 2024-04-15T14:58:54.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.285+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (unknown 1092875540 0 2268998900) 0x7fae38005420 con 0x7fae40146d70 2024-04-15T14:58:54.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.285+0000 7fae3cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:54.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.285+0000 7fae3cff9640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:54.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.408+0000 7fae46a21640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:58:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.408+0000 7fae46a21640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:58:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.408+0000 7fae46a21640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.408+0000 7fae46a21640 1 -- 172.21.15.38:0/1331839672 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae401dc330 con 0x7fae40146d70 2024-04-15T14:58:54.476 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-15T14:58:54.475+0000 7fd46902e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T14:58:54.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.860+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mgrmap(e 2) ==== 45545+0+0 (unknown 30025468 0 0) 0x7fae38005600 con 0x7fae40146d70 2024-04-15T14:58:54.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.946+0000 7fae3cff9640 1 -- 172.21.15.38:0/1331839672 <== mon.1 v1:172.21.15.164:6789/0 11 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1460008463) 0x7fae38015eb0 con 0x7fae40146d70 2024-04-15T14:58:54.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.946+0000 7fae3cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:58:54.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.946+0000 7fae3cff9640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:54.949 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:58:54.949 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":10,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:58:53.843518+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:58:54.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.947+0000 7fae46a21640 10 librados: watch_flush enter 2024-04-15T14:58:54.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.949+0000 7fae46a21640 10 librados: watch_flush exit 2024-04-15T14:58:54.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 20 client.4162.objecter shutdown clearing up homeless session... 2024-04-15T14:58:54.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 10 client.4162.objecter successfully canceled tick 2024-04-15T14:58:54.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 10 monclient: shutdown 2024-04-15T14:58:54.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:54.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 1 -- 172.21.15.38:0/1331839672 >> v1:172.21.15.164:6789/0 conn(0x7fae40146d70 legacy=0x7fae400ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:54.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 1 -- 172.21.15.38:0/1331839672 shutdown_connections 2024-04-15T14:58:54.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 1 -- 172.21.15.38:0/1331839672 >> 172.21.15.38:0/1331839672 conn(0x7fae40067790 msgr2=0x7fae4013d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:54.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 1 -- 172.21.15.38:0/1331839672 shutdown_connections 2024-04-15T14:58:54.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 1 -- 172.21.15.38:0/1331839672 wait complete. 2024-04-15T14:58:54.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:58:54.950+0000 7fae46a21640 1 librados: shutdown 2024-04-15T14:58:54.969 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-15T14:58:54.969 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-15T14:58:55.775 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T14:58:55.925 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.923+0000 7f70af9af640 10 monclient: get_monmap_and_config 2024-04-15T14:58:55.925 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.923+0000 7f70af9af640 10 monclient: build_initial_monmap 2024-04-15T14:58:55.925 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.923+0000 7f70af9af640 10 monclient: monmap: 2024-04-15T14:58:55.925 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:58:55.925 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:55.926 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:58:55.925088+0000 2024-04-15T14:58:55.926 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:58:55.925088+0000 2024-04-15T14:58:55.926 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:55.926 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:55.926 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:55.926 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:58:55.926 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:58:55.926 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:58:55.928 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.924+0000 7f70af9af640 1 Processor -- start 2024-04-15T14:58:55.928 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.924+0000 7f70af9af640 1 -- start start 2024-04-15T14:58:55.928 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.924+0000 7f70af9af640 10 monclient: init 2024-04-15T14:58:55.928 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:55.928 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:58:55.928 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 10 monclient(hunting): picked mon.noname-b con 0x7f70a80b3bb0 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:55.928 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 10 monclient(hunting): picked mon.noname-c con 0x7f70a8140a10 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:55.928 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 10 monclient(hunting): picked mon.noname-a con 0x7f70a8143d00 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:55.928 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a80ab9d0 con 0x7f70a8143d00 2024-04-15T14:58:55.929 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a80abc40 con 0x7f70a8140a10 2024-04-15T14:58:55.929 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a80abf20 con 0x7f70a80b3bb0 2024-04-15T14:58:55.929 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:55.929 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.925+0000 7f70af9af640 10 monclient(hunting): authenticate will time out at 1396.197050s 2024-04-15T14:58:55.929 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.927+0000 7f70acf4a640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f70a8140a10 0x7f70a81435f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:55192/0 (socket says 172.21.15.38:55192) 2024-04-15T14:58:55.929 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:55.927+0000 7f70acf4a640 1 -- 172.21.15.38:0/4038765718 learned_addr learned my addr 172.21.15.38:0/4038765718 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:58:56.242 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:56.240+0000 7fb9651d5640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-15T14:58:56.330 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.328+0000 7f709ffff640 1 -- 172.21.15.38:0/4038765718 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788277116 0 0) 0x7f70a80abc40 con 0x7f70a8140a10 2024-04-15T14:58:56.331 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.328+0000 7f709ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:58:56.331 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.328+0000 7f709ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:56.331 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.328+0000 7f709ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:56.331 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.328+0000 7f709ffff640 10 monclient(hunting): my global_id is 4177 2024-04-15T14:58:56.331 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.328+0000 7f709ffff640 1 -- 172.21.15.38:0/4038765718 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7094003520 con 0x7f70a8140a10 2024-04-15T14:58:56.336 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 1 -- 172.21.15.38:0/4038765718 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3581617995 0 0) 0x7f7094003520 con 0x7f70a8140a10 2024-04-15T14:58:56.336 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 1 -- 172.21.15.38:0/4038765718 >> v1:172.21.15.38:6790/0 conn(0x7f70a80b3bb0 legacy=0x7f70a8140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 1 -- 172.21.15.38:0/4038765718 >> v1:172.21.15.38:6789/0 conn(0x7f70a8143d00 legacy=0x7f70a814e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 10 monclient: _finish_hunting 0 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 1 monclient: found mon.noname-c 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 1 -- 172.21.15.38:0/4038765718 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a80aac20 con 0x7f70a8140a10 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 10 monclient: _finish_auth 0 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 10 monclient: _check_auth_tickets 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 1 -- 172.21.15.38:0/4038765718 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f70a4001610 con 0x7f70a8140a10 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f709ffff640 10 monclient: dump: 2024-04-15T14:58:56.337 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f70af9af640 5 monclient: authenticate success, global_id 4177 2024-04-15T14:58:56.338 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.334+0000 7f70af9af640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.338+0000 7f709ffff640 1 -- 172.21.15.38:0/4038765718 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70a4001870 con 0x7f70a8140a10 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.338+0000 7f709ffff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.338+0000 7f709ffff640 1 -- 172.21.15.38:0/4038765718 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f70a4001c40 con 0x7f70a8140a10 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.338+0000 7f709ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.338+0000 7f709ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.338+0000 7f709ffff640 10 monclient: dump: 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:56.340 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:56.341 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:56.341 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:58:56.341 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.338+0000 7f70af9af640 10 monclient: get_monmap_and_config success 2024-04-15T14:58:56.341 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.338+0000 7f70af9af640 4 set_mon_vals no callback set 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.339+0000 7f70af9af640 10 monclient: shutdown 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.339+0000 7f70af9af640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.339+0000 7f70af9af640 1 -- 172.21.15.38:0/4038765718 >> v1:172.21.15.164:6789/0 conn(0x7f70a8140a10 legacy=0x7f70a81435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.339+0000 7f70af9af640 1 -- 172.21.15.38:0/4038765718 shutdown_connections 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.339+0000 7f70af9af640 1 -- 172.21.15.38:0/4038765718 >> 172.21.15.38:0/4038765718 conn(0x7f70a8067870 msgr2=0x7f70a8067c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.339+0000 7f70af9af640 1 -- 172.21.15.38:0/4038765718 shutdown_connections 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.339+0000 7f70af9af640 1 -- 172.21.15.38:0/4038765718 wait complete. 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.340+0000 7f70af9af640 10 monclient: build_initial_monmap 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.340+0000 7f70af9af640 10 monclient: monmap: 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:58:56.342 INFO:teuthology.misc.health.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:58:56.343 INFO:teuthology.misc.health.smithi038.stderr:last_changed 0.000000 2024-04-15T14:58:56.343 INFO:teuthology.misc.health.smithi038.stderr:created 0.000000 2024-04-15T14:58:56.343 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:58:56.343 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 1 2024-04-15T14:58:56.343 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:58:56.343 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:58:56.343 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:58:56.343 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:58:56.345 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.340+0000 7f70af9af640 1 librados: starting msgr at 2024-04-15T14:58:56.345 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.340+0000 7f70af9af640 1 librados: starting objecter 2024-04-15T14:58:56.345 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.340+0000 7f70af9af640 1 Processor -- start 2024-04-15T14:58:56.345 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.341+0000 7f70af9af640 1 -- start start 2024-04-15T14:58:56.345 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.341+0000 7f70af9af640 1 librados: setting wanted keys 2024-04-15T14:58:56.345 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.341+0000 7f70af9af640 1 librados: calling monclient init 2024-04-15T14:58:56.345 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.341+0000 7f70af9af640 10 monclient: init 2024-04-15T14:58:56.345 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.341+0000 7f70af9af640 10 monclient: _reopen_session rank -1 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.341+0000 7f70af9af640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.341+0000 7f70af9af640 10 monclient(hunting): picked mon.noname-b con 0x7f70a80b3bb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.341+0000 7f70af9af640 10 monclient(hunting): picked mon.noname-c con 0x7f70a8140a10 addr v1:172.21.15.38:6790/0 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.342+0000 7f70af9af640 10 monclient(hunting): picked mon.noname-a con 0x7f70a8143d00 addr v1:172.21.15.38:6789/0 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.342+0000 7f70af9af640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a813db00 con 0x7f70a8143d00 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.342+0000 7f70af9af640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a80ad3f0 con 0x7f70a80b3bb0 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.342+0000 7f70af9af640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a80b2480 con 0x7f70a8140a10 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.342+0000 7f70af9af640 10 monclient(hunting): _renew_subs 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.342+0000 7f70af9af640 10 monclient(hunting): authenticate will time out at 1396.613661s 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.342+0000 7f70ad74b640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f70a80b3bb0 0x7f70a80b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:55200/0 (socket says 172.21.15.38:55200) 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.342+0000 7f70ad74b640 1 -- 172.21.15.38:0/2808878911 learned_addr learned my addr 172.21.15.38:0/2808878911 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.343+0000 7f709dffb640 10 client.?.objecter ms_handle_connect 0x7f70a80b3bb0 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.343+0000 7f709dffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:56.346 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.343+0000 7f709dffb640 10 client.?.objecter ms_handle_connect 0x7f70a8140a10 2024-04-15T14:58:56.347 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.343+0000 7f709dffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:58:56.348 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.346+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258808814 0 0) 0x7f70a80ad3f0 con 0x7f70a80b3bb0 2024-04-15T14:58:56.348 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.346+0000 7f709dffb640 10 monclient(hunting): _negotiate 2024-04-15T14:58:56.348 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.346+0000 7f709dffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:58:56.348 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.346+0000 7f709dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:58:56.348 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.346+0000 7f709dffb640 10 monclient(hunting): my global_id is 4180 2024-04-15T14:58:56.348 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.346+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f708c004eb0 con 0x7f70a80b3bb0 2024-04-15T14:58:56.356 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.354+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1230052876 0 0) 0x7f708c004eb0 con 0x7f70a80b3bb0 2024-04-15T14:58:56.356 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.354+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70a80ad3f0 con 0x7f70a80b3bb0 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.354+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7098001970 con 0x7f70a80b3bb0 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.354+0000 7f709dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.354+0000 7f709dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.354+0000 7f709dffb640 10 monclient(hunting): dump: 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:56.357 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:58:56.358 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.354+0000 7f709dffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.358+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1675664976 0 0) 0x7f70a80ad3f0 con 0x7f70a80b3bb0 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.358+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 >> v1:172.21.15.38:6790/0 conn(0x7f70a8140a10 legacy=0x7f70a813cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.358+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 >> v1:172.21.15.38:6789/0 conn(0x7f70a8143d00 legacy=0x7f70a813d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.358+0000 7f709dffb640 10 monclient: _finish_hunting 0 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.358+0000 7f709dffb640 1 monclient: found mon.b 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.358+0000 7f709dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.358+0000 7f709dffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a81dc810 con 0x7f70a80b3bb0 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f709dffb640 10 monclient: _finish_auth 0 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f709dffb640 10 monclient: _check_auth_tickets 2024-04-15T14:58:56.361 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f709dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:58:56.363 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f70af9af640 5 monclient: authenticate success, global_id 4180 2024-04-15T14:58:56.363 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f70af9af640 10 monclient: _renew_subs 2024-04-15T14:58:56.363 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f70af9af640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:56.363 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f70a80afe20 con 0x7f70a80b3bb0 2024-04-15T14:58:56.363 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f70af9af640 10 client.4180.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:58:56.363 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f70af9af640 10 monclient: _renew_subs 2024-04-15T14:58:56.363 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f70af9af640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:56.363 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f70a81dbda0 con 0x7f70a80b3bb0 2024-04-15T14:58:56.363 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.359+0000 7f70af9af640 1 librados: init done 2024-04-15T14:58:56.364 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.360+0000 7f70af9af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:56.364 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.360+0000 7f70af9af640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:56.364 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.360+0000 7f70af9af640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:56.364 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.360+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a8063620 con 0x7f70a80b3bb0 2024-04-15T14:58:56.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.816+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70980038c0 con 0x7f70a80b3bb0 2024-04-15T14:58:56.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.816+0000 7f709dffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:58:56.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.816+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7098003c90 con 0x7f70a80b3bb0 2024-04-15T14:58:56.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.816+0000 7f709dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:58:56.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.816+0000 7f709dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:58:56.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.816+0000 7f709dffb640 10 monclient: dump: 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:58:56.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.816+0000 7f709f7fe640 4 set_mon_vals no callback set 2024-04-15T14:58:56.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.817+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 3) ==== 90843+0+0 (unknown 2040961497 0 0) 0x7f7098003e30 con 0x7f70a80b3bb0 2024-04-15T14:58:56.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.818+0000 7f70acf4a640 10 monclient: get_auth_request con 0x7f708c06ec20 auth_method 0 2024-04-15T14:58:56.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.818+0000 7f709dffb640 10 client.4180.objecter ms_handle_connect 0x7f708c06ec20 2024-04-15T14:58:56.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.823+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 734170696 0 0) 0x7f7098053e10 con 0x7f70a80b3bb0 2024-04-15T14:58:56.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.823+0000 7f709dffb640 10 client.4180.objecter ms_dispatch 0x7f70a8000b90 osd_map(10..10 src has 1..10) 2024-04-15T14:58:56.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.823+0000 7f709dffb640 3 client.4180.objecter handle_osd_map got epochs [10,10] > 0 2024-04-15T14:58:56.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.823+0000 7f709dffb640 3 client.4180.objecter handle_osd_map decoding full epoch 10 2024-04-15T14:58:56.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.823+0000 7f709dffb640 20 client.4180.objecter dump_active .. 0 homeless 2024-04-15T14:58:56.828 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.826+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f7098055880 con 0x7f70a80b3bb0 2024-04-15T14:58:56.828 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.826+0000 7f709dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:58:56.828 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:56.826+0000 7f709dffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:58:57.207 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.204+0000 7f70af9af640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:58:57.207 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.204+0000 7f70af9af640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:58:57.207 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.204+0000 7f70af9af640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:58:57.207 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.204+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70a80696f0 con 0x7f70a80b3bb0 2024-04-15T14:58:57.208 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T14:58:57.206+0000 7fb9651d5640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-15T14:58:57.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.408+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mgrmap(e 4) ==== 90949+0+0 (unknown 3427149683 0 0) 0x7f7098050e40 con 0x7f70a80b3bb0 2024-04-15T14:58:57.465 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.462+0000 7f709dffb640 1 -- 172.21.15.38:0/2808878911 <== mon.1 v1:172.21.15.164:6789/0 11 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1460008463) 0x7f7098059790 con 0x7f70a80b3bb0 2024-04-15T14:58:57.465 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.462+0000 7f709dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:58:57.465 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.462+0000 7f709dffb640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:58:57.465 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-15T14:58:57.465 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:58:53.843518+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:58:57.467 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.465+0000 7f70af9af640 10 librados: watch_flush enter 2024-04-15T14:58:57.467 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.465+0000 7f70af9af640 10 librados: watch_flush exit 2024-04-15T14:58:57.467 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.465+0000 7f70af9af640 20 client.4180.objecter shutdown clearing up homeless session... 2024-04-15T14:58:57.467 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.465+0000 7f70af9af640 10 client.4180.objecter successfully canceled tick 2024-04-15T14:58:57.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.466+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 >> v1:172.21.15.38:6800/1608957829 conn(0x7f708c06ec20 legacy=0x7f708c0710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:57.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.466+0000 7f70af9af640 10 monclient: shutdown 2024-04-15T14:58:57.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.466+0000 7f70af9af640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:58:57.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.466+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 >> v1:172.21.15.164:6789/0 conn(0x7f70a80b3bb0 legacy=0x7f70a80b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:58:57.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.466+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 shutdown_connections 2024-04-15T14:58:57.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.466+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 >> 172.21.15.38:0/2808878911 conn(0x7f70a8067870 msgr2=0x7f70a81435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:58:57.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.466+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 shutdown_connections 2024-04-15T14:58:57.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.466+0000 7f70af9af640 1 -- 172.21.15.38:0/2808878911 wait complete. 2024-04-15T14:58:57.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:58:57.467+0000 7f70af9af640 1 librados: shutdown 2024-04-15T14:58:57.482 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-15T14:59:00.814 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:06.824 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:00.874 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:06.884 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:00.964 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:06.964 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.009 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:07.004 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.027 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:07.026 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.068 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:07.063 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.175 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:07.195 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.234 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:07.253 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.392 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:07.389 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.421 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-15T14:59:01.415+0000 5dc3480 -1 Falling back to public interface 2024-04-15T14:59:01.454 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:07.451 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.541 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:07.545 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.569 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:07.576 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.585 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:01.579+0000 5dc3480 -1 Falling back to public interface 2024-04-15T14:59:01.602 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:07.607 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.630 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:07.637 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.634 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T14:59:01.627+0000 5dc3480 -1 Falling back to public interface 2024-04-15T14:59:01.662 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:07.658 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.722 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:07.718 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.785 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:01.778+0000 5dc3480 -1 Falling back to public interface 2024-04-15T14:59:01.868 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:07.878 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:01.996 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:01.988+0000 5dc3480 -1 Falling back to public interface 2024-04-15T14:59:02.082 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:08.081 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.138 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:08.133 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.174 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T14:59:02.166+0000 5dc3480 -1 Falling back to public interface 2024-04-15T14:59:02.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T14:59:02.170+0000 5dc3480 -1 Falling back to public interface 2024-04-15T14:59:02.249 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:08.269 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.262 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:08.269 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.305 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:02.297+0000 5dc3480 -1 Falling back to public interface 2024-04-15T14:59:02.455 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:08.452 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.482 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:08.482 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.541 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:08.537 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.599 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:08.608 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.651 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:08.671 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.652 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:08.659 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.660 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:08.664 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.794 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:08.790 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.817 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:08.816 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.835 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:08.831 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.849 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:08.846 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.887 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:08.897 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:02.980 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:09.000 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.043 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:09.050 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.056 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:09.061 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.106 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:09.101 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.112 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:09.111 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.178 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:09.188 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.187 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:09.184 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.189 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:09.185 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.267 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:09.287 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.333 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:09.341 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.355 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:09.360 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.374 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:09.370 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.405 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:09.404 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.465 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:09.475 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.479 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:09.476 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.527 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:09.523 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.557 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:09.577 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.605 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:09.611 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.638 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:09.643 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.639 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:09.634 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.692 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:09.691 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.759 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:09.769 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.768 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:09.765 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.822 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:09.818 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.846 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:09.866 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.869 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:09.877 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.911 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:09.916 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.912 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:09.907 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:03.979 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:09.978 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.047 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:10.057 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.057 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:10.054 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.111 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:10.106 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.133 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:10.153 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.140 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:10.148 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.177 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:10.172 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.179 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:10.184 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.266 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:10.265 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.290 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T14:59:04.334 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:10.344 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.354 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:10.351 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.383 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.381+0000 7fc08da2a640 10 monclient: get_monmap_and_config 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.381+0000 7fc08da2a640 10 monclient: build_initial_monmap 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.381+0000 7fc08da2a640 10 monclient: monmap: 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:59:04.383602+0000 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:59:04.383602+0000 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:04.384 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:04.385 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.382+0000 7fc08da2a640 1 Processor -- start 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.382+0000 7fc08da2a640 1 -- start start 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.382+0000 7fc08da2a640 10 monclient: init 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 10 monclient(hunting): picked mon.noname-b con 0x7fc088072eb0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 10 monclient(hunting): picked mon.noname-c con 0x7fc0881404c0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 10 monclient(hunting): picked mon.noname-a con 0x7fc088146db0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc088147220 con 0x7fc088146db0 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0880ab220 con 0x7fc0881404c0 2024-04-15T14:59:04.386 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0880aad00 con 0x7fc088072eb0 2024-04-15T14:59:04.387 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:04.387 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc08da2a640 10 monclient(hunting): authenticate will time out at 1404.654537s 2024-04-15T14:59:04.387 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc086ffd640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fc088072eb0 0x7fc0880aa4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:41898/0 (socket says 172.21.15.38:41898) 2024-04-15T14:59:04.387 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.383+0000 7fc086ffd640 1 -- 172.21.15.38:0/3057278248 learned_addr learned my addr 172.21.15.38:0/3057278248 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:04.388 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3070046785 0 0) 0x7fc0880ab220 con 0x7fc0881404c0 2024-04-15T14:59:04.388 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:04.388 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:04.388 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:04.388 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): my global_id is 4207 2024-04-15T14:59:04.388 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc070003520 con 0x7fc0881404c0 2024-04-15T14:59:04.388 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224632054 0 0) 0x7fc080001490 con 0x7fc088146db0 2024-04-15T14:59:04.388 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): my global_id is 4212 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0880ab220 con 0x7fc088146db0 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020856252 0 0) 0x7fc0880aad00 con 0x7fc088072eb0 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 10 monclient(hunting): my global_id is 54125 2024-04-15T14:59:04.389 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.386+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc080001490 con 0x7fc088072eb0 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3243088675 0 0) 0x7fc070003520 con 0x7fc0881404c0 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 >> v1:172.21.15.38:6790/0 conn(0x7fc088072eb0 legacy=0x7fc0880aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 >> v1:172.21.15.38:6789/0 conn(0x7fc088146db0 legacy=0x7fc08814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 10 monclient: _finish_hunting 0 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 1 monclient: found mon.noname-c 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0880b5470 con 0x7fc0881404c0 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 10 monclient: _finish_auth 0 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 10 monclient: _check_auth_tickets 2024-04-15T14:59:04.391 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:04.392 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc07c001610 con 0x7fc0881404c0 2024-04-15T14:59:04.392 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.388+0000 7fc085ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:04.392 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.389+0000 7fc085ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:04.392 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.389+0000 7fc085ffb640 10 monclient: dump: 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.389+0000 7fc08da2a640 5 monclient: authenticate success, global_id 4207 2024-04-15T14:59:04.393 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.389+0000 7fc08da2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:04.396 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.390+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc07c001870 con 0x7fc0881404c0 2024-04-15T14:59:04.396 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.390+0000 7fc085ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:04.396 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.390+0000 7fc085ffb640 1 -- 172.21.15.38:0/3057278248 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc07c001bc0 con 0x7fc0881404c0 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.390+0000 7fc08da2a640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.390+0000 7fc085ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.390+0000 7fc08da2a640 4 set_mon_vals no callback set 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.390+0000 7fc085ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.390+0000 7fc085ffb640 10 monclient: dump: 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:04.397 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.391+0000 7fc08da2a640 10 monclient: shutdown 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.391+0000 7fc08da2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.391+0000 7fc08da2a640 1 -- 172.21.15.38:0/3057278248 >> v1:172.21.15.164:6789/0 conn(0x7fc0881404c0 legacy=0x7fc0881466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.391+0000 7fc08da2a640 1 -- 172.21.15.38:0/3057278248 shutdown_connections 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.391+0000 7fc08da2a640 1 -- 172.21.15.38:0/3057278248 >> 172.21.15.38:0/3057278248 conn(0x7fc0880b8c50 msgr2=0x7fc0880b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.391+0000 7fc08da2a640 1 -- 172.21.15.38:0/3057278248 shutdown_connections 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.391+0000 7fc08da2a640 1 -- 172.21.15.38:0/3057278248 wait complete. 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.391+0000 7fc08da2a640 10 monclient: build_initial_monmap 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.391+0000 7fc08da2a640 10 monclient: monmap: 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:04.398 INFO:teuthology.misc.health.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:created 0.000000 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.392+0000 7fc08da2a640 1 librados: starting msgr at 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.392+0000 7fc08da2a640 1 librados: starting objecter 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.392+0000 7fc08da2a640 1 Processor -- start 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.392+0000 7fc08da2a640 1 -- start start 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.392+0000 7fc08da2a640 1 librados: setting wanted keys 2024-04-15T14:59:04.399 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.392+0000 7fc08da2a640 1 librados: calling monclient init 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.392+0000 7fc08da2a640 10 monclient: init 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 10 monclient(hunting): picked mon.noname-c con 0x7fc088072eb0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 10 monclient(hunting): picked mon.noname-b con 0x7fc0881404c0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 10 monclient(hunting): picked mon.noname-a con 0x7fc088146db0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc088143cc0 con 0x7fc088146db0 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc088143fa0 con 0x7fc0881404c0 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0881430c0 con 0x7fc088072eb0 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc08da2a640 10 monclient(hunting): authenticate will time out at 1404.664556s 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc086ffd640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fc088072eb0 0x7fc088141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:41910/0 (socket says 172.21.15.38:41910) 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc086ffd640 1 -- 172.21.15.38:0/2857590881 learned_addr learned my addr 172.21.15.38:0/2857590881 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:04.400 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc0877fe640 1 --1- 172.21.15.38:0/2857590881 >> v1:172.21.15.38:6789/0 conn(0x7fc088146db0 0x7fc0881e3040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:38884/0 (socket says 172.21.15.38:38884) 2024-04-15T14:59:04.401 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc06ffff640 10 client.?.objecter ms_handle_connect 0x7fc088072eb0 2024-04-15T14:59:04.401 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc06ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:04.401 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc06ffff640 10 client.?.objecter ms_handle_connect 0x7fc0881404c0 2024-04-15T14:59:04.401 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc06ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:04.401 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc06ffff640 10 client.?.objecter ms_handle_connect 0x7fc088146db0 2024-04-15T14:59:04.401 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.393+0000 7fc06ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490290377 0 0) 0x7fc088143fa0 con 0x7fc0881404c0 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 10 monclient(hunting): my global_id is 4210 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc074004eb0 con 0x7fc0881404c0 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500380390 0 0) 0x7fc0881430c0 con 0x7fc088072eb0 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:04.402 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:04.403 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 10 monclient(hunting): my global_id is 54128 2024-04-15T14:59:04.403 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.395+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc088143fa0 con 0x7fc088072eb0 2024-04-15T14:59:04.403 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.396+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716957879 0 0) 0x7fc088143cc0 con 0x7fc088146db0 2024-04-15T14:59:04.403 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.396+0000 7fc06ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:04.403 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.396+0000 7fc06ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:04.403 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.396+0000 7fc06ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:04.403 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.396+0000 7fc06ffff640 10 monclient(hunting): my global_id is 4215 2024-04-15T14:59:04.403 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.396+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0881430c0 con 0x7fc088146db0 2024-04-15T14:59:04.404 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:10.396 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.399+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4836489 0 0) 0x7fc074004eb0 con 0x7fc0881404c0 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.400+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc088143cc0 con 0x7fc0881404c0 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.400+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc07c001510 con 0x7fc0881404c0 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.400+0000 7fc06ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.400+0000 7fc06ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.400+0000 7fc06ffff640 10 monclient(hunting): dump: 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:04.406 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.400+0000 7fc06ffff640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.400+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3375475341 0 0) 0x7fc0881430c0 con 0x7fc088146db0 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.400+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc074004eb0 con 0x7fc088146db0 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.401+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc080001ca0 con 0x7fc088146db0 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.401+0000 7fc06ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.401+0000 7fc06ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.401+0000 7fc06ffff640 10 monclient(hunting): dump: 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.407 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 531433909 0 0) 0x7fc088143cc0 con 0x7fc0881404c0 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 >> v1:172.21.15.38:6790/0 conn(0x7fc088072eb0 legacy=0x7fc088141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 >> v1:172.21.15.38:6789/0 conn(0x7fc088146db0 legacy=0x7fc0881e3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 1 monclient: found mon.b 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc088142710 con 0x7fc0881404c0 2024-04-15T14:59:04.408 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 10 monclient: _finish_auth 0 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc06ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc08da2a640 5 monclient: authenticate success, global_id 4210 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc08da2a640 10 monclient: _renew_subs 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc08da2a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc08813c670 con 0x7fc0881404c0 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc08da2a640 10 client.4210.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc08da2a640 10 monclient: _renew_subs 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc08da2a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0881e4760 con 0x7fc0881404c0 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.403+0000 7fc08da2a640 1 librados: init done 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.404+0000 7fc08da2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.404+0000 7fc08da2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:04.409 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.404+0000 7fc08da2a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:04.410 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.404+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc088063620 con 0x7fc0881404c0 2024-04-15T14:59:04.421 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:10.428 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.424 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:10.444 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.448 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:10.453 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.452 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:10.447 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.566 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:10.565 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.615 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.613+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc07c0017d0 con 0x7fc0881404c0 2024-04-15T14:59:04.615 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.613+0000 7fc06ffff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:04.615 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.613+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc07c003a40 con 0x7fc0881404c0 2024-04-15T14:59:04.615 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.613+0000 7fc06ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:04.615 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.613+0000 7fc06ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:04.615 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.613+0000 7fc06ffff640 10 monclient: dump: 2024-04-15T14:59:04.615 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:04.615 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:04.616 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.616 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:04.616 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:04.616 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:04.616 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:04.616 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:04.616 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:04.616 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:04.616 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.613+0000 7fc0857fa640 4 set_mon_vals no callback set 2024-04-15T14:59:04.643 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:10.640 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.663 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.661+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 4) ==== 90949+0+0 (unknown 3427149683 0 0) 0x7fc07c019f30 con 0x7fc0881404c0 2024-04-15T14:59:04.663 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.661+0000 7fc086ffd640 10 monclient: get_auth_request con 0x7fc07406ed10 auth_method 0 2024-04-15T14:59:04.663 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.661+0000 7fc06ffff640 10 client.4210.objecter ms_handle_connect 0x7fc07406ed10 2024-04-15T14:59:04.666 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.664+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 734170696 0 0) 0x7fc07c0847a0 con 0x7fc0881404c0 2024-04-15T14:59:04.666 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.664+0000 7fc06ffff640 10 client.4210.objecter ms_dispatch 0x7fc088000b90 osd_map(10..10 src has 1..10) 2024-04-15T14:59:04.666 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.664+0000 7fc06ffff640 3 client.4210.objecter handle_osd_map got epochs [10,10] > 0 2024-04-15T14:59:04.667 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.664+0000 7fc06ffff640 3 client.4210.objecter handle_osd_map decoding full epoch 10 2024-04-15T14:59:04.667 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.664+0000 7fc06ffff640 20 client.4210.objecter dump_active .. 0 homeless 2024-04-15T14:59:04.668 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.666+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fc07c0544d0 con 0x7fc0881404c0 2024-04-15T14:59:04.668 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.666+0000 7fc06ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:04.669 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.666+0000 7fc06ffff640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:04.693 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:10.700 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.699 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:10.694 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.715 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:10.720 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.720 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:10.741 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.853+0000 7fc08da2a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:04.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.853+0000 7fc08da2a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:04.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.853+0000 7fc08da2a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:04.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.853+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0880b7a10 con 0x7fc0881404c0 2024-04-15T14:59:04.869 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.868+0000 7fc06ffff640 1 -- 172.21.15.38:0/2857590881 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1460008463) 0x7fc07c053dd0 con 0x7fc0881404c0 2024-04-15T14:59:04.869 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.868+0000 7fc06ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:04.870 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.868+0000 7fc06ffff640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:04.870 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-15T14:59:04.870 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:58:53.843518+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:59:04.872 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 10 librados: watch_flush enter 2024-04-15T14:59:04.872 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 10 librados: watch_flush exit 2024-04-15T14:59:04.872 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 20 client.4210.objecter shutdown clearing up homeless session... 2024-04-15T14:59:04.872 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 10 client.4210.objecter successfully canceled tick 2024-04-15T14:59:04.872 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 >> v1:172.21.15.38:6800/1608957829 conn(0x7fc07406ed10 legacy=0x7fc0740711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:04.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 10 monclient: shutdown 2024-04-15T14:59:04.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:04.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 >> v1:172.21.15.164:6789/0 conn(0x7fc0881404c0 legacy=0x7fc08813bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:04.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 shutdown_connections 2024-04-15T14:59:04.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 >> 172.21.15.38:0/2857590881 conn(0x7fc0880b8c50 msgr2=0x7fc0880b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:04.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 shutdown_connections 2024-04-15T14:59:04.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 1 -- 172.21.15.38:0/2857590881 wait complete. 2024-04-15T14:59:04.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:04.870+0000 7fc08da2a640 1 librados: shutdown 2024-04-15T14:59:04.881 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-15T14:59:04.896 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:10.906 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.928 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:10.938 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.937 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:10.934 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.973 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:10.969 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.974 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:10.982 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.995 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:11.000 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:04.996 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:10.991 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.028 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:11.023 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.141 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:11.141 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.173 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:11.172 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.290 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:11.285 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.322 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:11.342 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.379 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:11.399 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.506 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:11.502 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.506 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:11.513 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.527 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:11.532 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.538 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:11.535 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.539 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:11.545 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.560 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:11.564 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.843 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:11.838 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:05.875 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:11.871 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:10.055 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:16.065 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:10.294 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:16.289 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:10.462 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:16.462 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:10.615 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:16.635 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:11.348 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:17.356 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:11.389 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:17.385 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:11.474 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:17.479 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:11.511 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:17.508 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:11.688 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T14:59:11.797 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.796+0000 7f003a300640 10 monclient: get_monmap_and_config 2024-04-15T14:59:11.797 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.796+0000 7f003a300640 10 monclient: build_initial_monmap 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.796+0000 7f003a300640 10 monclient: monmap: 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:59:11.797478+0000 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:59:11.797478+0000 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:11.798 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:11.799 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.797+0000 7f003a300640 1 Processor -- start 2024-04-15T14:59:11.799 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.797+0000 7f003a300640 1 -- start start 2024-04-15T14:59:11.799 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.797+0000 7f003a300640 10 monclient: init 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 10 monclient(hunting): picked mon.noname-a con 0x7f0034072eb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 10 monclient(hunting): picked mon.noname-b con 0x7f00341404c0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 10 monclient(hunting): picked mon.noname-c con 0x7f0034146db0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0034147220 con 0x7f0034072eb0 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00340ab220 con 0x7f0034146db0 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00340aad00 con 0x7f00341404c0 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f003a300640 10 monclient(hunting): authenticate will time out at 1412.068719s 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f00337fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f00341404c0 0x7f00341466a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:41924/0 (socket says 172.21.15.38:41924) 2024-04-15T14:59:11.800 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.798+0000 7f00337fe640 1 -- 172.21.15.38:0/451593197 learned_addr learned my addr 172.21.15.38:0/451593197 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:11.802 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831824596 0 0) 0x7f00340aad00 con 0x7f00341404c0 2024-04-15T14:59:11.802 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:11.803 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:11.803 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:11.803 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 10 monclient(hunting): my global_id is 54131 2024-04-15T14:59:11.803 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f001c003520 con 0x7f00341404c0 2024-04-15T14:59:11.804 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941345136 0 0) 0x7f0024001110 con 0x7f0034072eb0 2024-04-15T14:59:11.804 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:11.804 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:11.805 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:11.805 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 10 monclient(hunting): my global_id is 4218 2024-04-15T14:59:11.805 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.802+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00340aad00 con 0x7f0034072eb0 2024-04-15T14:59:11.805 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.803+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565172149 0 0) 0x7f00340ab220 con 0x7f0034146db0 2024-04-15T14:59:11.805 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.803+0000 7f0032ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:11.805 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.803+0000 7f0032ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:11.805 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.803+0000 7f0032ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:11.805 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.803+0000 7f0032ffd640 10 monclient(hunting): my global_id is 4213 2024-04-15T14:59:11.805 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.803+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0024001110 con 0x7f0034146db0 2024-04-15T14:59:11.808 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 510071820 0 0) 0x7f001c003520 con 0x7f00341404c0 2024-04-15T14:59:11.808 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 >> v1:172.21.15.164:6789/0 conn(0x7f0034146db0 legacy=0x7f003414ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:11.808 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 >> v1:172.21.15.38:6789/0 conn(0x7f0034072eb0 legacy=0x7f00340aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:11.808 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:11.808 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 1 monclient: found mon.noname-b 2024-04-15T14:59:11.808 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:11.808 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:11.808 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00340b5470 con 0x7f00341404c0 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0028001610 con 0x7f00341404c0 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f0032ffd640 10 monclient: dump: 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:11.809 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f003a300640 5 monclient: authenticate success, global_id 54131 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.805+0000 7f003a300640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0028001870 con 0x7f00341404c0 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f0032ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f0032ffd640 1 -- 172.21.15.38:0/451593197 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0028001bc0 con 0x7f00341404c0 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f0032ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f0032ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f0032ffd640 10 monclient: dump: 2024-04-15T14:59:11.810 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:11.811 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:11.811 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.811 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.811 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:11.811 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:11.811 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:11.811 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:11.811 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:11.812 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:11.812 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f003a300640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:11.812 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f003a300640 4 set_mon_vals no callback set 2024-04-15T14:59:11.817 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f003a300640 10 monclient: shutdown 2024-04-15T14:59:11.817 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f003a300640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:11.817 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.807+0000 7f003a300640 1 -- 172.21.15.38:0/451593197 >> v1:172.21.15.38:6790/0 conn(0x7f00341404c0 legacy=0x7f00341466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:11.817 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.808+0000 7f003a300640 1 -- 172.21.15.38:0/451593197 shutdown_connections 2024-04-15T14:59:11.817 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.808+0000 7f003a300640 1 -- 172.21.15.38:0/451593197 >> 172.21.15.38:0/451593197 conn(0x7f00340b8c50 msgr2=0x7f00340b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.808+0000 7f003a300640 1 -- 172.21.15.38:0/451593197 shutdown_connections 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.808+0000 7f003a300640 1 -- 172.21.15.38:0/451593197 wait complete. 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.809+0000 7f003a300640 10 monclient: build_initial_monmap 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.809+0000 7f003a300640 10 monclient: monmap: 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:created 0.000000 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:11.818 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.809+0000 7f003a300640 1 librados: starting msgr at 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.809+0000 7f003a300640 1 librados: starting objecter 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.809+0000 7f003a300640 1 Processor -- start 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 1 -- start start 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 1 librados: setting wanted keys 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 1 librados: calling monclient init 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 10 monclient: init 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 10 monclient(hunting): picked mon.noname-b con 0x7f0034072eb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 10 monclient(hunting): picked mon.noname-c con 0x7f00341404c0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 10 monclient(hunting): picked mon.noname-a con 0x7f0034146db0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:11.819 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00341d8240 con 0x7f0034146db0 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00341d8520 con 0x7f0034072eb0 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00341d9150 con 0x7f00341404c0 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.810+0000 7f003a300640 10 monclient(hunting): authenticate will time out at 1412.081380s 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.811+0000 7f0033fff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0034072eb0 0x7f00341d8a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:57246/0 (socket says 172.21.15.38:57246) 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.811+0000 7f00337fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f00341404c0 0x7f0034139f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:41934/0 (socket says 172.21.15.38:41934) 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.811+0000 7f00337fe640 1 -- 172.21.15.38:0/3980262481 learned_addr learned my addr 172.21.15.38:0/3980262481 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.811+0000 7f0030ff9640 10 client.?.objecter ms_handle_connect 0x7f0034072eb0 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.811+0000 7f0030ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.812+0000 7f0030ff9640 10 client.?.objecter ms_handle_connect 0x7f00341404c0 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.812+0000 7f0030ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.812+0000 7f0030ff9640 10 client.?.objecter ms_handle_connect 0x7f0034146db0 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.812+0000 7f0030ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:11.820 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.814+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009673655 0 0) 0x7f00341d9150 con 0x7f00341404c0 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.814+0000 7f0030ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.814+0000 7f0030ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.814+0000 7f0030ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.814+0000 7f0030ff9640 10 monclient(hunting): my global_id is 54134 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.814+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0020004eb0 con 0x7f00341404c0 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.815+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224896985 0 0) 0x7f00341d8520 con 0x7f0034072eb0 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.815+0000 7f0030ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.815+0000 7f0030ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.815+0000 7f0030ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.815+0000 7f0030ff9640 10 monclient(hunting): my global_id is 4216 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.815+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00341d9150 con 0x7f0034072eb0 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.816+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738250236 0 0) 0x7f00341d8240 con 0x7f0034146db0 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.816+0000 7f0030ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:59:11.821 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.816+0000 7f0030ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:11.822 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.816+0000 7f0030ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:11.822 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.816+0000 7f0030ff9640 10 monclient(hunting): my global_id is 4221 2024-04-15T14:59:11.822 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.816+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00200053a0 con 0x7f0034146db0 2024-04-15T14:59:11.822 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.820+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2433232276 0 0) 0x7f0020004eb0 con 0x7f00341404c0 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.820+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00341d8240 con 0x7f00341404c0 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.820+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f00280015d0 con 0x7f00341404c0 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.820+0000 7f0030ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.820+0000 7f0030ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.820+0000 7f0030ff9640 10 monclient(hunting): dump: 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.823 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:11.824 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:11.824 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:11.824 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:11.824 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:11.824 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:11.824 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.820+0000 7f0030ff9640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.824+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2466520077 0 0) 0x7f00341d9150 con 0x7f0034072eb0 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.824+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0020004eb0 con 0x7f0034072eb0 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.824+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0024001a40 con 0x7f0034072eb0 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.824+0000 7f0030ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.824+0000 7f0030ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.824+0000 7f0030ff9640 10 monclient(hunting): dump: 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:11.825 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:11.826 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:11.826 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:11.826 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:11.827 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.826+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2456010319 0 0) 0x7f00200053a0 con 0x7f0034146db0 2024-04-15T14:59:11.827 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.826+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0020006190 con 0x7f0034146db0 2024-04-15T14:59:11.827 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.826+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f002c001b90 con 0x7f0034146db0 2024-04-15T14:59:11.827 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.826+0000 7f0030ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:11.827 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.826+0000 7f0030ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:11.827 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.826+0000 7f0030ff9640 10 monclient(hunting): dump: 2024-04-15T14:59:11.827 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:11.827 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:11.828 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.828 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.828 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:11.828 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:11.828 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:11.828 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:11.828 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:11.828 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:11.829 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 415353684 0 0) 0x7f0020004eb0 con 0x7f0034072eb0 2024-04-15T14:59:11.829 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 >> v1:172.21.15.38:6790/0 conn(0x7f00341404c0 legacy=0x7f0034139f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:11.829 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 >> v1:172.21.15.38:6789/0 conn(0x7f0034146db0 legacy=0x7f00340ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 10 monclient: _finish_hunting 0 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 1 monclient: found mon.b 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003413a620 con 0x7f0034072eb0 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 10 monclient: _finish_auth 0 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 10 monclient: _check_auth_tickets 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f0030ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f003a300640 5 monclient: authenticate success, global_id 4216 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f003a300640 10 monclient: _renew_subs 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f003a300640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:11.830 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f00340ace10 con 0x7f0034072eb0 2024-04-15T14:59:11.831 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f003a300640 10 client.4216.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:11.831 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f003a300640 10 monclient: _renew_subs 2024-04-15T14:59:11.831 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f003a300640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:11.831 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f00340ae310 con 0x7f0034072eb0 2024-04-15T14:59:11.831 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.828+0000 7f003a300640 1 librados: init done 2024-04-15T14:59:11.832 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.829+0000 7f003a300640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:11.832 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.829+0000 7f003a300640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:11.832 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.829+0000 7f003a300640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:11.832 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.829+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0034063620 con 0x7f0034072eb0 2024-04-15T14:59:11.832 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.830+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00240038c0 con 0x7f0034072eb0 2024-04-15T14:59:11.832 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.830+0000 7f0030ff9640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:11.832 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.830+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f00240018a0 con 0x7f0034072eb0 2024-04-15T14:59:11.832 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.830+0000 7f0030ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:11.832 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.830+0000 7f0030ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.830+0000 7f0030ff9640 10 monclient: dump: 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:11.833 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:11.830+0000 7f00327fc640 4 set_mon_vals no callback set 2024-04-15T14:59:12.085 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.084+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 4) ==== 90949+0+0 (unknown 3427149683 0 0) 0x7f0024003a70 con 0x7f0034072eb0 2024-04-15T14:59:12.090 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.085+0000 7f00337fe640 10 monclient: get_auth_request con 0x7f002006f420 auth_method 0 2024-04-15T14:59:12.090 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.085+0000 7f0030ff9640 10 client.4216.objecter ms_handle_connect 0x7f002006f420 2024-04-15T14:59:12.090 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.088+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 734170696 0 0) 0x7f0024085810 con 0x7f0034072eb0 2024-04-15T14:59:12.090 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.088+0000 7f0030ff9640 10 client.4216.objecter ms_dispatch 0x7f0034000b90 osd_map(10..10 src has 1..10) 2024-04-15T14:59:12.090 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.088+0000 7f0030ff9640 3 client.4216.objecter handle_osd_map got epochs [10,10] > 0 2024-04-15T14:59:12.090 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.088+0000 7f0030ff9640 3 client.4216.objecter handle_osd_map decoding full epoch 10 2024-04-15T14:59:12.090 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.088+0000 7f0030ff9640 20 client.4216.objecter dump_active .. 0 homeless 2024-04-15T14:59:12.091 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.090+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f0034147220 con 0x7f0034072eb0 2024-04-15T14:59:12.091 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.090+0000 7f0030ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:12.092 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.090+0000 7f0030ff9640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:12.448 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.447+0000 7f003a300640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:12.449 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.447+0000 7f003a300640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:12.449 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.447+0000 7f003a300640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:12.449 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.447+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0034063620 con 0x7f0034072eb0 2024-04-15T14:59:12.465 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.464+0000 7f0030ff9640 1 -- 172.21.15.38:0/3980262481 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1460008463) 0x7f0024055540 con 0x7f0034072eb0 2024-04-15T14:59:12.465 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.464+0000 7f0030ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:12.465 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.464+0000 7f0030ff9640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:12.465 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-15T14:59:12.466 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:58:53.843518+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:59:12.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 10 librados: watch_flush enter 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 10 librados: watch_flush exit 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 20 client.4216.objecter shutdown clearing up homeless session... 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 10 client.4216.objecter successfully canceled tick 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 >> v1:172.21.15.38:6800/1608957829 conn(0x7f002006f420 legacy=0x7f00200718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 10 monclient: shutdown 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 >> v1:172.21.15.164:6789/0 conn(0x7f0034072eb0 legacy=0x7f00341d8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 shutdown_connections 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 >> 172.21.15.38:0/3980262481 conn(0x7f00340b8c50 msgr2=0x7f003413f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 shutdown_connections 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 1 -- 172.21.15.38:0/3980262481 wait complete. 2024-04-15T14:59:12.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:12.467+0000 7f003a300640 1 librados: shutdown 2024-04-15T14:59:12.481 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-15T14:59:15.562 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:21.557 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:15.568 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:21.564 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:15.672 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:21.682 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:15.676 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:21.686 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:16.106 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:22.126 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:16.110 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:22.130 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:16.135 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:22.134 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:16.139 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:22.139 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:16.797 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:22.792 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:16.801 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:22.797 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:17.256 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:23.261 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:17.260 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:23.265 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:17.365 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:23.372 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:17.371 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:23.378 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:17.545 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:23.542 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:17.549 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:23.546 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:19.287 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.423+0000 7fa6d51c3640 10 monclient: get_monmap_and_config 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.423+0000 7fa6d51c3640 10 monclient: build_initial_monmap 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.423+0000 7fa6d51c3640 10 monclient: monmap: 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:59:19.424585+0000 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:59:19.424585+0000 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:19.425 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:19.426 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:19.426 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:19.427 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.424+0000 7fa6d51c3640 1 Processor -- start 2024-04-15T14:59:19.427 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.424+0000 7fa6d51c3640 1 -- start start 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.424+0000 7fa6d51c3640 10 monclient: init 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 10 monclient(hunting): picked mon.noname-c con 0x7fa6d0072eb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 10 monclient(hunting): picked mon.noname-b con 0x7fa6d01404c0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 10 monclient(hunting): picked mon.noname-a con 0x7fa6d0146db0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d0147220 con 0x7fa6d0146db0 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d00ab220 con 0x7fa6d0072eb0 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d00aad00 con 0x7fa6d01404c0 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.425+0000 7fa6d51c3640 10 monclient(hunting): authenticate will time out at 1419.696333s 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.426+0000 7fa6ced9d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fa6d0072eb0 0x7fa6d00aa4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:46442/0 (socket says 172.21.15.38:46442) 2024-04-15T14:59:19.428 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.426+0000 7fa6ced9d640 1 -- 172.21.15.38:0/207040114 learned_addr learned my addr 172.21.15.38:0/207040114 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:19.430 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.428+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950838667 0 0) 0x7fa6d00ab220 con 0x7fa6d0072eb0 2024-04-15T14:59:19.430 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.428+0000 7fa6cdd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:19.430 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.428+0000 7fa6cdd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:19.430 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.428+0000 7fa6cdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:19.430 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.428+0000 7fa6cdd9b640 10 monclient(hunting): my global_id is 4219 2024-04-15T14:59:19.431 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.428+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b8003520 con 0x7fa6d0072eb0 2024-04-15T14:59:19.431 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393849896 0 0) 0x7fa6d00aad00 con 0x7fa6d01404c0 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 10 monclient(hunting): my global_id is 54137 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b8003880 con 0x7fa6d01404c0 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827019833 0 0) 0x7fa6c8001490 con 0x7fa6d0146db0 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 10 monclient(hunting): my global_id is 4224 2024-04-15T14:59:19.432 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.430+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6d00aad00 con 0x7fa6d0146db0 2024-04-15T14:59:19.435 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 784421935 0 0) 0x7fa6b8003520 con 0x7fa6d0072eb0 2024-04-15T14:59:19.435 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 >> v1:172.21.15.38:6790/0 conn(0x7fa6d01404c0 legacy=0x7fa6d01466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 >> v1:172.21.15.38:6789/0 conn(0x7fa6d0146db0 legacy=0x7fa6d014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 10 monclient: _finish_hunting 0 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 1 monclient: found mon.noname-c 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d00b5470 con 0x7fa6d0072eb0 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 10 monclient: _finish_auth 0 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 10 monclient: _check_auth_tickets 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa6c00015f0 con 0x7fa6d0072eb0 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6cdd9b640 10 monclient: dump: 2024-04-15T14:59:19.436 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6d51c3640 5 monclient: authenticate success, global_id 4219 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.432+0000 7fa6d51c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.434+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6c0001850 con 0x7fa6d0072eb0 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.434+0000 7fa6cdd9b640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.434+0000 7fa6d51c3640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:19.437 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.434+0000 7fa6d51c3640 4 set_mon_vals no callback set 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.434+0000 7fa6cdd9b640 1 -- 172.21.15.38:0/207040114 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa6c0001ba0 con 0x7fa6d0072eb0 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.434+0000 7fa6cdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.434+0000 7fa6cdd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.434+0000 7fa6cdd9b640 10 monclient: dump: 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:19.438 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:19.439 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:19.441 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.435+0000 7fa6d51c3640 10 monclient: shutdown 2024-04-15T14:59:19.441 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.435+0000 7fa6d51c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:19.441 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.435+0000 7fa6d51c3640 1 -- 172.21.15.38:0/207040114 >> v1:172.21.15.164:6789/0 conn(0x7fa6d0072eb0 legacy=0x7fa6d00aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:19.441 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.435+0000 7fa6d51c3640 1 -- 172.21.15.38:0/207040114 shutdown_connections 2024-04-15T14:59:19.441 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.435+0000 7fa6d51c3640 1 -- 172.21.15.38:0/207040114 >> 172.21.15.38:0/207040114 conn(0x7fa6d00b8c50 msgr2=0x7fa6d00b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.436+0000 7fa6d51c3640 1 -- 172.21.15.38:0/207040114 shutdown_connections 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.436+0000 7fa6d51c3640 1 -- 172.21.15.38:0/207040114 wait complete. 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.437+0000 7fa6d51c3640 10 monclient: build_initial_monmap 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.437+0000 7fa6d51c3640 10 monclient: monmap: 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:created 0.000000 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:19.442 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.438+0000 7fa6d51c3640 1 librados: starting msgr at 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.438+0000 7fa6d51c3640 1 librados: starting objecter 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.438+0000 7fa6d51c3640 1 Processor -- start 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.438+0000 7fa6d51c3640 1 -- start start 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.438+0000 7fa6d51c3640 1 librados: setting wanted keys 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.438+0000 7fa6d51c3640 1 librados: calling monclient init 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.439+0000 7fa6d51c3640 10 monclient: init 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 10 monclient(hunting): picked mon.noname-a con 0x7fa6d0072eb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 10 monclient(hunting): picked mon.noname-b con 0x7fa6d01404c0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 10 monclient(hunting): picked mon.noname-c con 0x7fa6d0146db0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:19.443 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d0145770 con 0x7fa6d0072eb0 2024-04-15T14:59:19.444 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d0146480 con 0x7fa6d01404c0 2024-04-15T14:59:19.444 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d013a3d0 con 0x7fa6d0146db0 2024-04-15T14:59:19.444 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:19.444 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.440+0000 7fa6d51c3640 10 monclient(hunting): authenticate will time out at 1419.711278s 2024-04-15T14:59:19.445 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.441+0000 7fa6ced9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa6d0072eb0 0x7fa6d0145b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:54724/0 (socket says 172.21.15.38:54724) 2024-04-15T14:59:19.445 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.441+0000 7fa6ced9d640 1 -- 172.21.15.38:0/3200208454 learned_addr learned my addr 172.21.15.38:0/3200208454 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:19.445 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.442+0000 7fa6b77fe640 10 client.?.objecter ms_handle_connect 0x7fa6d0072eb0 2024-04-15T14:59:19.445 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.442+0000 7fa6b77fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:19.445 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.443+0000 7fa6b77fe640 10 client.?.objecter ms_handle_connect 0x7fa6d01404c0 2024-04-15T14:59:19.445 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.443+0000 7fa6b77fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:19.445 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.444+0000 7fa6b77fe640 10 client.?.objecter ms_handle_connect 0x7fa6d0146db0 2024-04-15T14:59:19.445 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.444+0000 7fa6b77fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:19.447 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.445+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552096584 0 0) 0x7fa6d0146480 con 0x7fa6d01404c0 2024-04-15T14:59:19.447 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.445+0000 7fa6b77fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:19.447 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.445+0000 7fa6b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:19.447 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.445+0000 7fa6b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:19.447 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.445+0000 7fa6b77fe640 10 monclient(hunting): my global_id is 4222 2024-04-15T14:59:19.447 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.445+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6bc004eb0 con 0x7fa6d01404c0 2024-04-15T14:59:19.450 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944050568 0 0) 0x7fa6d013a3d0 con 0x7fa6d0146db0 2024-04-15T14:59:19.450 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:19.450 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:19.450 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:19.450 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 10 monclient(hunting): my global_id is 54140 2024-04-15T14:59:19.450 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6d0146480 con 0x7fa6d0146db0 2024-04-15T14:59:19.450 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606311001 0 0) 0x7fa6d0145770 con 0x7fa6d0072eb0 2024-04-15T14:59:19.451 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:19.451 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:19.451 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:19.451 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 10 monclient(hunting): my global_id is 4227 2024-04-15T14:59:19.451 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.449+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6d013a3d0 con 0x7fa6d0072eb0 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.450+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2986378905 0 0) 0x7fa6bc004eb0 con 0x7fa6d01404c0 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.450+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6d0145770 con 0x7fa6d01404c0 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.450+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa6c40018b0 con 0x7fa6d01404c0 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.450+0000 7fa6b77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.450+0000 7fa6b77fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.450+0000 7fa6b77fe640 10 monclient(hunting): dump: 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:19.452 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:19.453 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:19.453 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:19.453 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:19.453 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:19.453 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:19.453 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.450+0000 7fa6b77fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:19.454 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 291327281 0 0) 0x7fa6d0145770 con 0x7fa6d01404c0 2024-04-15T14:59:19.454 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 >> v1:172.21.15.38:6790/0 conn(0x7fa6d0146db0 legacy=0x7fa6d01391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 >> v1:172.21.15.38:6789/0 conn(0x7fa6d0072eb0 legacy=0x7fa6d0145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 1 monclient: found mon.b 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d01cfec0 con 0x7fa6d01404c0 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6d51c3640 5 monclient: authenticate success, global_id 4222 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6d51c3640 10 monclient: _renew_subs 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6d51c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6d51c3640 1 -- 172.21.15.38:0/3200208454 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d01d0150 con 0x7fa6d01404c0 2024-04-15T14:59:19.455 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6d51c3640 10 client.4222.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:19.456 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6d51c3640 10 monclient: _renew_subs 2024-04-15T14:59:19.456 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6d51c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:19.456 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.453+0000 7fa6d51c3640 1 -- 172.21.15.38:0/3200208454 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa6d0139ab0 con 0x7fa6d01404c0 2024-04-15T14:59:19.456 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.454+0000 7fa6d51c3640 1 librados: init done 2024-04-15T14:59:19.456 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.455+0000 7fa6b57fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:19.456 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.455+0000 7fa6b57fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:19.456 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.455+0000 7fa6b57fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:19.457 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.455+0000 7fa6b57fa640 1 -- 172.21.15.38:0/3200208454 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b0005080 con 0x7fa6d01404c0 2024-04-15T14:59:19.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.468+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6c40035f0 con 0x7fa6d01404c0 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.468+0000 7fa6b77fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.468+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa6c4003940 con 0x7fa6d01404c0 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.468+0000 7fa6b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.468+0000 7fa6b77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.468+0000 7fa6cd59a640 4 set_mon_vals no callback set 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.468+0000 7fa6b77fe640 10 monclient: dump: 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:19.470 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:19.471 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:19.471 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:19.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.470+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 4) ==== 90949+0+0 (unknown 3427149683 0 0) 0x7fa6c4019e30 con 0x7fa6d01404c0 2024-04-15T14:59:19.473 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.471+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 734170696 0 0) 0x7fa6c40848b0 con 0x7fa6d01404c0 2024-04-15T14:59:19.473 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.471+0000 7fa6b77fe640 10 client.4222.objecter ms_dispatch 0x7fa6d0000b90 osd_map(10..10 src has 1..10) 2024-04-15T14:59:19.473 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.471+0000 7fa6b77fe640 3 client.4222.objecter handle_osd_map got epochs [10,10] > 0 2024-04-15T14:59:19.473 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.471+0000 7fa6b77fe640 3 client.4222.objecter handle_osd_map decoding full epoch 10 2024-04-15T14:59:19.473 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.471+0000 7fa6ced9d640 10 monclient: get_auth_request con 0x7fa6bc06ee50 auth_method 0 2024-04-15T14:59:19.473 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.471+0000 7fa6b77fe640 20 client.4222.objecter dump_active .. 0 homeless 2024-04-15T14:59:19.473 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.471+0000 7fa6b77fe640 10 client.4222.objecter ms_handle_connect 0x7fa6bc06ee50 2024-04-15T14:59:19.586 INFO:tasks.ceph.osd.6.smithi164.stderr:==00:00:00:25.581 35394== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:19.591 INFO:tasks.ceph.osd.7.smithi164.stderr:==00:00:00:25.601 35392== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:19.816 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.814+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fa6c40545e0 con 0x7fa6d01404c0 2024-04-15T14:59:19.816 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.815+0000 7fa6b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:19.816 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:19.815+0000 7fa6b77fe640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:19.886 INFO:tasks.ceph.osd.4.smithi164.stderr:==00:00:00:25.906 35391== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:20.005 INFO:tasks.ceph.osd.5.smithi164.stderr:==00:00:00:26.004 35393== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:20.105 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.104+0000 7fa6b57fa640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:20.105 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.104+0000 7fa6b57fa640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:20.105 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.104+0000 7fa6b57fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:20.105 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.104+0000 7fa6b57fa640 1 -- 172.21.15.38:0/3200208454 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6b0005370 con 0x7fa6d01404c0 2024-04-15T14:59:20.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.130+0000 7fa6b77fe640 1 -- 172.21.15.38:0/3200208454 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1460008463) 0x7fa6c4053ee0 con 0x7fa6d01404c0 2024-04-15T14:59:20.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.130+0000 7fa6b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:20.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.130+0000 7fa6b77fe640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:20.131 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-15T14:59:20.132 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:58:53.843518+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:59:20.134 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.132+0000 7fa6b57fa640 10 librados: watch_flush enter 2024-04-15T14:59:20.134 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.132+0000 7fa6b57fa640 10 librados: watch_flush exit 2024-04-15T14:59:20.134 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.132+0000 7fa6b57fa640 20 client.4222.objecter shutdown clearing up homeless session... 2024-04-15T14:59:20.134 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.132+0000 7fa6b57fa640 10 client.4222.objecter successfully canceled tick 2024-04-15T14:59:20.134 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.133+0000 7fa6b57fa640 1 -- 172.21.15.38:0/3200208454 >> v1:172.21.15.38:6800/1608957829 conn(0x7fa6bc06ee50 legacy=0x7fa6bc071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:20.134 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.133+0000 7fa6b57fa640 10 monclient: shutdown 2024-04-15T14:59:20.134 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.133+0000 7fa6b57fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:20.134 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.133+0000 7fa6b57fa640 1 -- 172.21.15.38:0/3200208454 >> v1:172.21.15.164:6789/0 conn(0x7fa6d01404c0 legacy=0x7fa6d0143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:20.135 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.133+0000 7fa6b57fa640 1 -- 172.21.15.38:0/3200208454 shutdown_connections 2024-04-15T14:59:20.135 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.133+0000 7fa6b57fa640 1 -- 172.21.15.38:0/3200208454 >> 172.21.15.38:0/3200208454 conn(0x7fa6d00b8c50 msgr2=0x7fa6d00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:20.135 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.133+0000 7fa6b57fa640 1 -- 172.21.15.38:0/3200208454 shutdown_connections 2024-04-15T14:59:20.135 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.133+0000 7fa6b57fa640 1 -- 172.21.15.38:0/3200208454 wait complete. 2024-04-15T14:59:20.135 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:20.133+0000 7fa6b57fa640 1 librados: shutdown 2024-04-15T14:59:20.144 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-15T14:59:21.189 INFO:tasks.ceph.osd.3.smithi038.stderr:==00:00:00:27.184 35560== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:21.846 INFO:tasks.ceph.osd.0.smithi038.stderr:==00:00:00:27.850 35559== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:21.882 INFO:tasks.ceph.osd.2.smithi038.stderr:==00:00:00:27.879 35561== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:22.038 INFO:tasks.ceph.osd.1.smithi038.stderr:==00:00:00:28.045 35558== Warning: unimplemented fcntl command: 1038 2024-04-15T14:59:26.950 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T14:59:27.085 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.084+0000 7ff8fdb78640 10 monclient: get_monmap_and_config 2024-04-15T14:59:27.085 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.084+0000 7ff8fdb78640 10 monclient: build_initial_monmap 2024-04-15T14:59:27.085 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.084+0000 7ff8fdb78640 10 monclient: monmap: 2024-04-15T14:59:27.085 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:27.085 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:27.085 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:59:27.085072+0000 2024-04-15T14:59:27.086 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:59:27.085072+0000 2024-04-15T14:59:27.086 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:27.086 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:27.086 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:27.086 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:27.086 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:27.086 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.085+0000 7ff8fdb78640 1 Processor -- start 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.085+0000 7ff8fdb78640 1 -- start start 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.085+0000 7ff8fdb78640 10 monclient: init 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.085+0000 7ff8fdb78640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.085+0000 7ff8fdb78640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.085+0000 7ff8fdb78640 10 monclient(hunting): picked mon.noname-c con 0x7ff8f8072eb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.085+0000 7ff8fdb78640 10 monclient(hunting): picked mon.noname-a con 0x7ff8f81404c0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.086+0000 7ff8fdb78640 10 monclient(hunting): picked mon.noname-b con 0x7ff8f8146db0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.086+0000 7ff8fdb78640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f8147220 con 0x7ff8f81404c0 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.086+0000 7ff8fdb78640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f80ab220 con 0x7ff8f8072eb0 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.086+0000 7ff8fdb78640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f80aad00 con 0x7ff8f8146db0 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.086+0000 7ff8fdb78640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:27.088 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.086+0000 7ff8fdb78640 10 monclient(hunting): authenticate will time out at 1427.356711s 2024-04-15T14:59:27.089 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.086+0000 7ff8f7fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7ff8f8146db0 0x7ff8f814ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:58446/0 (socket says 172.21.15.38:58446) 2024-04-15T14:59:27.089 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.086+0000 7ff8f7fff640 1 -- 172.21.15.38:0/1250951768 learned_addr learned my addr 172.21.15.38:0/1250951768 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:27.104 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.103+0000 7ff8f67fc640 1 -- 172.21.15.38:0/1250951768 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637867234 0 0) 0x7ff8ec001110 con 0x7ff8f81404c0 2024-04-15T14:59:27.104 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.103+0000 7ff8f67fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:27.105 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.103+0000 7ff8f67fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:27.105 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.103+0000 7ff8f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:27.105 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.103+0000 7ff8f67fc640 10 monclient(hunting): my global_id is 4230 2024-04-15T14:59:27.105 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.103+0000 7ff8f67fc640 1 -- 172.21.15.38:0/1250951768 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e0003520 con 0x7ff8f81404c0 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 1 -- 172.21.15.38:0/1250951768 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1822267927 0 0) 0x7ff8e0003520 con 0x7ff8f81404c0 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 1 -- 172.21.15.38:0/1250951768 >> v1:172.21.15.38:6790/0 conn(0x7ff8f8146db0 legacy=0x7ff8f814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 1 -- 172.21.15.38:0/1250951768 >> v1:172.21.15.164:6789/0 conn(0x7ff8f8072eb0 legacy=0x7ff8f80aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 1 monclient: found mon.noname-a 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 1 -- 172.21.15.38:0/1250951768 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f80b5470 con 0x7ff8f81404c0 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:27.110 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 1 -- 172.21.15.38:0/1250951768 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff8ec0017e0 con 0x7ff8f81404c0 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8f67fc640 10 monclient: dump: 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:27.111 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.108+0000 7ff8fdb78640 5 monclient: authenticate success, global_id 4230 2024-04-15T14:59:27.112 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.109+0000 7ff8fdb78640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:27.113 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.110+0000 7ff8f67fc640 1 -- 172.21.15.38:0/1250951768 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8ec001a40 con 0x7ff8f81404c0 2024-04-15T14:59:27.113 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.110+0000 7ff8f67fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:27.113 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.110+0000 7ff8fdb78640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:27.113 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.110+0000 7ff8fdb78640 4 set_mon_vals no callback set 2024-04-15T14:59:27.113 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8f67fc640 1 -- 172.21.15.38:0/1250951768 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff8ec003610 con 0x7ff8f81404c0 2024-04-15T14:59:27.113 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:27.113 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8f67fc640 10 monclient: dump: 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8fdb78640 10 monclient: shutdown 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8fdb78640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:27.114 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8fdb78640 1 -- 172.21.15.38:0/1250951768 >> v1:172.21.15.38:6789/0 conn(0x7ff8f81404c0 legacy=0x7ff8f81466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:27.115 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8fdb78640 1 -- 172.21.15.38:0/1250951768 shutdown_connections 2024-04-15T14:59:27.115 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8fdb78640 1 -- 172.21.15.38:0/1250951768 >> 172.21.15.38:0/1250951768 conn(0x7ff8f80b8c50 msgr2=0x7ff8f80b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:27.115 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.111+0000 7ff8fdb78640 1 -- 172.21.15.38:0/1250951768 shutdown_connections 2024-04-15T14:59:27.115 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.112+0000 7ff8fdb78640 1 -- 172.21.15.38:0/1250951768 wait complete. 2024-04-15T14:59:27.117 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.112+0000 7ff8fdb78640 10 monclient: build_initial_monmap 2024-04-15T14:59:27.117 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.112+0000 7ff8fdb78640 10 monclient: monmap: 2024-04-15T14:59:27.117 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:27.117 INFO:teuthology.misc.health.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:27.117 INFO:teuthology.misc.health.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:27.117 INFO:teuthology.misc.health.smithi038.stderr:created 0.000000 2024-04-15T14:59:27.117 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.113+0000 7ff8fdb78640 1 librados: starting msgr at 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.113+0000 7ff8fdb78640 1 librados: starting objecter 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.113+0000 7ff8fdb78640 1 Processor -- start 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.113+0000 7ff8fdb78640 1 -- start start 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.113+0000 7ff8fdb78640 1 librados: setting wanted keys 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.113+0000 7ff8fdb78640 1 librados: calling monclient init 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.113+0000 7ff8fdb78640 10 monclient: init 2024-04-15T14:59:27.118 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.114+0000 7ff8fdb78640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.114+0000 7ff8fdb78640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.114+0000 7ff8fdb78640 10 monclient(hunting): picked mon.noname-a con 0x7ff8f8072eb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.114+0000 7ff8fdb78640 10 monclient(hunting): picked mon.noname-b con 0x7ff8f81404c0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.114+0000 7ff8fdb78640 10 monclient(hunting): picked mon.noname-c con 0x7ff8f8146db0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.115+0000 7ff8fdb78640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f81ccec0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.115+0000 7ff8fdb78640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f81cf480 con 0x7ff8f81404c0 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.115+0000 7ff8fdb78640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f8139580 con 0x7ff8f8146db0 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.115+0000 7ff8fdb78640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.115+0000 7ff8fdb78640 10 monclient(hunting): authenticate will time out at 1427.385693s 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.115+0000 7ff8f77fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff8f8072eb0 0x7ff8f81cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:47552/0 (socket says 172.21.15.38:47552) 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.115+0000 7ff8f77fe640 1 -- 172.21.15.38:0/2478267509 learned_addr learned my addr 172.21.15.38:0/2478267509 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.115+0000 7ff8dffff640 10 client.?.objecter ms_handle_connect 0x7ff8f8072eb0 2024-04-15T14:59:27.119 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.115+0000 7ff8dffff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:27.120 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.118+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811013795 0 0) 0x7ff8f81ccec0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.120 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.118+0000 7ff8dffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:27.120 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.118+0000 7ff8dffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:27.120 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.118+0000 7ff8dffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:27.121 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.118+0000 7ff8dffff640 10 monclient(hunting): my global_id is 4233 2024-04-15T14:59:27.121 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.118+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e4004eb0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.124 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.123+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 862942584 0 0) 0x7ff8e4004eb0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.124 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.123+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8f81ccec0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.123+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff8e8001910 con 0x7ff8f8072eb0 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.123+0000 7ff8dffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.123+0000 7ff8dffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.123+0000 7ff8dffff640 10 monclient(hunting): dump: 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:27.125 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.123+0000 7ff8dffff640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:27.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1899601074 0 0) 0x7ff8f81ccec0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 >> v1:172.21.15.38:6790/0 conn(0x7ff8f8146db0 legacy=0x7ff8f81cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:27.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 >> v1:172.21.15.164:6789/0 conn(0x7ff8f81404c0 legacy=0x7ff8f8138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:27.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:27.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 1 monclient: found mon.a 2024-04-15T14:59:27.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:27.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:27.131 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f8139750 con 0x7ff8f8072eb0 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 10 monclient: _finish_auth 0 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8fdb78640 5 monclient: authenticate success, global_id 4233 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8fdb78640 10 monclient: _renew_subs 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8fdb78640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f8139ae0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8fdb78640 10 client.4233.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8fdb78640 10 monclient: _renew_subs 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8fdb78640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff8f81cdab0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.128+0000 7ff8fdb78640 1 librados: init done 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.130+0000 7ff8fdb78640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.130+0000 7ff8fdb78640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:27.132 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.130+0000 7ff8fdb78640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:27.133 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.130+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f8063620 con 0x7ff8f8072eb0 2024-04-15T14:59:27.133 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.131+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8e8001cd0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.133 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.131+0000 7ff8dffff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:27.133 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.131+0000 7ff8f5ffb640 4 set_mon_vals no callback set 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.227+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff8e8003a60 con 0x7ff8f8072eb0 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.227+0000 7ff8dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.227+0000 7ff8dffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.227+0000 7ff8dffff640 10 monclient: dump: 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:27.228 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:27.229 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:27.229 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:27.229 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:27.230 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.228+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 4) ==== 90949+0+0 (unknown 3427149683 0 0) 0x7ff8e8003c80 con 0x7ff8f8072eb0 2024-04-15T14:59:27.230 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.229+0000 7ff8f6ffd640 10 monclient: get_auth_request con 0x7ff8e406ece0 auth_method 0 2024-04-15T14:59:27.230 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.229+0000 7ff8dffff640 10 client.4233.objecter ms_handle_connect 0x7ff8e406ece0 2024-04-15T14:59:27.540 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.539+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 734170696 0 0) 0x7ff8e8085bf0 con 0x7ff8f8072eb0 2024-04-15T14:59:27.540 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.539+0000 7ff8dffff640 10 client.4233.objecter ms_dispatch 0x7ff8f8000b90 osd_map(10..10 src has 1..10) 2024-04-15T14:59:27.540 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.539+0000 7ff8dffff640 3 client.4233.objecter handle_osd_map got epochs [10,10] > 0 2024-04-15T14:59:27.540 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.539+0000 7ff8dffff640 3 client.4233.objecter handle_osd_map decoding full epoch 10 2024-04-15T14:59:27.540 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.539+0000 7ff8dffff640 20 client.4233.objecter dump_active .. 0 homeless 2024-04-15T14:59:27.541 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.539+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7ff8e8055920 con 0x7ff8f8072eb0 2024-04-15T14:59:27.541 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.539+0000 7ff8dffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:27.541 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.539+0000 7ff8dffff640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:27.723 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T14:59:27.719+0000 5dc3480 -1 osd.6 0 log_to_monitors true 2024-04-15T14:59:27.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.850+0000 7ff8fdb78640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:27.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.850+0000 7ff8fdb78640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:27.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.850+0000 7ff8fdb78640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:27.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.850+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8f81cf230 con 0x7ff8f8072eb0 2024-04-15T14:59:27.915 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.914+0000 7ff8dffff640 1 -- 172.21.15.38:0/2478267509 <== mon.0 v1:172.21.15.38:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1460008463) 0x7ff8e8055220 con 0x7ff8f8072eb0 2024-04-15T14:59:27.915 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.914+0000 7ff8dffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:27.915 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.914+0000 7ff8dffff640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:27.915 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-15T14:59:27.915 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:58:53.843518+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:59:27.918 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.916+0000 7ff8fdb78640 10 librados: watch_flush enter 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 10 librados: watch_flush exit 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 20 client.4233.objecter shutdown clearing up homeless session... 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 10 client.4233.objecter successfully canceled tick 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 >> v1:172.21.15.38:6800/1608957829 conn(0x7ff8e406ece0 legacy=0x7ff8e40711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 10 monclient: shutdown 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 >> v1:172.21.15.38:6789/0 conn(0x7ff8f8072eb0 legacy=0x7ff8f81cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 shutdown_connections 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 >> 172.21.15.38:0/2478267509 conn(0x7ff8f80b8c50 msgr2=0x7ff8f80b6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 shutdown_connections 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 1 -- 172.21.15.38:0/2478267509 wait complete. 2024-04-15T14:59:27.919 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:27.917+0000 7ff8fdb78640 1 librados: shutdown 2024-04-15T14:59:27.932 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-15T14:59:27.973 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-15T14:59:27.969+0000 5dc3480 -1 osd.7 0 log_to_monitors true 2024-04-15T14:59:28.012 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:28.008+0000 5dc3480 -1 osd.4 0 log_to_monitors true 2024-04-15T14:59:28.131 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:28.075+0000 5dc3480 -1 osd.5 0 log_to_monitors true 2024-04-15T14:59:30.024 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:30.020+0000 5dc3480 -1 osd.3 0 log_to_monitors true 2024-04-15T14:59:30.516 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T14:59:30.512+0000 5dc3480 -1 osd.0 0 log_to_monitors true 2024-04-15T14:59:30.532 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:30.527+0000 5dc3480 -1 osd.2 0 log_to_monitors true 2024-04-15T14:59:30.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T14:59:30.661+0000 5dc3480 -1 osd.1 0 log_to_monitors true 2024-04-15T14:59:31.001 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T14:59:30.997+0000 bc8e640 -1 osd.6 0 waiting for initial osdmap 2024-04-15T14:59:31.395 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T14:59:31.381+0000 10255640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T14:59:34.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T14:59:34.392+0000 b47a640 -1 osd.1 0 waiting for initial osdmap 2024-04-15T14:59:34.418 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T14:59:34.407+0000 bc8e640 -1 osd.0 0 waiting for initial osdmap 2024-04-15T14:59:34.740 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T14:59:34.848 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.847+0000 7f60649c4640 10 monclient: get_monmap_and_config 2024-04-15T14:59:34.848 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.847+0000 7f60649c4640 10 monclient: build_initial_monmap 2024-04-15T14:59:34.848 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.847+0000 7f60649c4640 10 monclient: monmap: 2024-04-15T14:59:34.848 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:34.848 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:34.848 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:59:34.847889+0000 2024-04-15T14:59:34.848 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:59:34.847889+0000 2024-04-15T14:59:34.848 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:34.848 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:34.849 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:34.849 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:34.849 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:34.849 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:34.850 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.847+0000 7f60649c4640 1 Processor -- start 2024-04-15T14:59:34.850 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 1 -- start start 2024-04-15T14:59:34.850 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 10 monclient: init 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 10 monclient(hunting): picked mon.noname-a con 0x7f6060072eb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 10 monclient(hunting): picked mon.noname-c con 0x7f60601404c0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 10 monclient(hunting): picked mon.noname-b con 0x7f6060146db0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6060147220 con 0x7f6060072eb0 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60600ab220 con 0x7f60601404c0 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60600aad00 con 0x7f6060146db0 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.848+0000 7f60649c4640 10 monclient(hunting): authenticate will time out at 1435.119198s 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.849+0000 7f605e59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6060072eb0 0x7f60600aa4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48008/0 (socket says 172.21.15.38:48008) 2024-04-15T14:59:34.851 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.849+0000 7f605e59c640 1 -- 172.21.15.38:0/1793348064 learned_addr learned my addr 172.21.15.38:0/1793348064 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:34.853 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051761269 0 0) 0x7f6050001110 con 0x7f6060072eb0 2024-04-15T14:59:34.853 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:34.853 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:34.853 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:34.853 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 10 monclient(hunting): my global_id is 4260 2024-04-15T14:59:34.853 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f604c003520 con 0x7f6060072eb0 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127535549 0 0) 0x7f60600ab220 con 0x7f60601404c0 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.852+0000 7f605dd9b640 10 monclient(hunting): my global_id is 4249 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.853+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6050001110 con 0x7f60601404c0 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.853+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798080764 0 0) 0x7f60600aad00 con 0x7f6060146db0 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.853+0000 7f605dd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.853+0000 7f605dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.853+0000 7f605dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.853+0000 7f605dd9b640 10 monclient(hunting): my global_id is 54161 2024-04-15T14:59:34.855 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.853+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60600ab220 con 0x7f6060146db0 2024-04-15T14:59:34.857 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3378820010 0 0) 0x7f604c003520 con 0x7f6060072eb0 2024-04-15T14:59:34.857 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 >> v1:172.21.15.38:6790/0 conn(0x7f6060146db0 legacy=0x7f606014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 >> v1:172.21.15.164:6789/0 conn(0x7f60601404c0 legacy=0x7f60601466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 10 monclient: _finish_hunting 0 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 1 monclient: found mon.noname-a 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60600b5470 con 0x7f6060072eb0 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 10 monclient: _finish_auth 0 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 10 monclient: _check_auth_tickets 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.856+0000 7f605dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.857+0000 7f60649c4640 5 monclient: authenticate success, global_id 4260 2024-04-15T14:59:34.858 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.857+0000 7f60649c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.858+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f60500017e0 con 0x7f6060072eb0 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.858+0000 7f605dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.858+0000 7f605dd9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.858+0000 7f605dd9b640 10 monclient: dump: 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:34.859 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:34.860 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:34.860 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:34.860 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:34.860 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:34.860 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.858+0000 7f60649c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:34.860 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.859+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6050001a00 con 0x7f6060072eb0 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.859+0000 7f605dd9b640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.859+0000 7f605dd9b640 1 -- 172.21.15.38:0/1793348064 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f60500048a0 con 0x7f6060072eb0 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.859+0000 7f60649c4640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.859+0000 7f60649c4640 4 set_mon_vals no callback set 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.859+0000 7f605dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.859+0000 7f605dd9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.859+0000 7f605dd9b640 10 monclient: dump: 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:34.861 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:34.862 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:34.862 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:34.862 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:34.863 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.860+0000 7f60649c4640 10 monclient: shutdown 2024-04-15T14:59:34.863 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.860+0000 7f60649c4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:34.863 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.860+0000 7f60649c4640 1 -- 172.21.15.38:0/1793348064 >> v1:172.21.15.38:6789/0 conn(0x7f6060072eb0 legacy=0x7f60600aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:34.863 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.860+0000 7f60649c4640 1 -- 172.21.15.38:0/1793348064 shutdown_connections 2024-04-15T14:59:34.863 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.860+0000 7f60649c4640 1 -- 172.21.15.38:0/1793348064 >> 172.21.15.38:0/1793348064 conn(0x7f60600b8c50 msgr2=0x7f60600b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.860+0000 7f60649c4640 1 -- 172.21.15.38:0/1793348064 shutdown_connections 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.860+0000 7f60649c4640 1 -- 172.21.15.38:0/1793348064 wait complete. 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.861+0000 7f60649c4640 10 monclient: build_initial_monmap 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.861+0000 7f60649c4640 10 monclient: monmap: 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:created 0.000000 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:34.864 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:34.865 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.862+0000 7f60649c4640 1 librados: starting msgr at 2024-04-15T14:59:34.865 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.862+0000 7f60649c4640 1 librados: starting objecter 2024-04-15T14:59:34.865 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.862+0000 7f60649c4640 1 Processor -- start 2024-04-15T14:59:34.865 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.862+0000 7f60649c4640 1 -- start start 2024-04-15T14:59:34.865 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.862+0000 7f60649c4640 1 librados: setting wanted keys 2024-04-15T14:59:34.865 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.862+0000 7f60649c4640 1 librados: calling monclient init 2024-04-15T14:59:34.865 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.862+0000 7f60649c4640 10 monclient: init 2024-04-15T14:59:34.872 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:34.872 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 10 monclient(hunting): picked mon.noname-b con 0x7f6060072eb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 10 monclient(hunting): picked mon.noname-c con 0x7f60601404c0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 10 monclient(hunting): picked mon.noname-a con 0x7f6060146db0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6060144fe0 con 0x7f6060146db0 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6060145250 con 0x7f6060072eb0 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6060145d80 con 0x7f60601404c0 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.863+0000 7f60649c4640 10 monclient(hunting): authenticate will time out at 1435.134149s 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.864+0000 7f6057fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f60601404c0 0x7f6060138d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:52630/0 (socket says 172.21.15.38:52630) 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.864+0000 7f605e59c640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6060072eb0 0x7f6060140fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:59596/0 (socket says 172.21.15.38:59596) 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.864+0000 7f6057fff640 1 -- 172.21.15.38:0/419507556 learned_addr learned my addr 172.21.15.38:0/419507556 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:34.873 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.864+0000 7f6056ffd640 10 client.?.objecter ms_handle_connect 0x7f6060072eb0 2024-04-15T14:59:34.874 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.864+0000 7f6056ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:34.874 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.864+0000 7f6056ffd640 10 client.?.objecter ms_handle_connect 0x7f60601404c0 2024-04-15T14:59:34.874 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.864+0000 7f6056ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:34.874 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.864+0000 7f6056ffd640 10 client.?.objecter ms_handle_connect 0x7f6060146db0 2024-04-15T14:59:34.874 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.864+0000 7f6056ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:34.874 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.866+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648988959 0 0) 0x7f6060145250 con 0x7f6060072eb0 2024-04-15T14:59:34.874 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.866+0000 7f6056ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:34.874 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.866+0000 7f6056ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:34.874 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.866+0000 7f6056ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.866+0000 7f6056ffd640 10 monclient(hunting): my global_id is 4252 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.866+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6040004eb0 con 0x7f6060072eb0 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.867+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605524132 0 0) 0x7f6060144fe0 con 0x7f6060146db0 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.867+0000 7f6056ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.867+0000 7f6056ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.867+0000 7f6056ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.867+0000 7f6056ffd640 10 monclient(hunting): my global_id is 4263 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.867+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6060145250 con 0x7f6060146db0 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.868+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908288335 0 0) 0x7f6060145d80 con 0x7f60601404c0 2024-04-15T14:59:34.875 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.868+0000 7f6056ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:34.876 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.868+0000 7f6056ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:34.876 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.868+0000 7f6056ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:34.876 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.868+0000 7f6056ffd640 10 monclient(hunting): my global_id is 54164 2024-04-15T14:59:34.876 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.868+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6060144fe0 con 0x7f60601404c0 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.872+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1031742440 0 0) 0x7f6060144fe0 con 0x7f60601404c0 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.872+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6060145d80 con 0x7f60601404c0 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.872+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f60480018f0 con 0x7f60601404c0 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.872+0000 7f6056ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.872+0000 7f6056ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.872+0000 7f6056ffd640 10 monclient(hunting): dump: 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.877 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.872+0000 7f6056ffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.872+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1804708440 0 0) 0x7f6040004eb0 con 0x7f6060072eb0 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.872+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6060144fe0 con 0x7f6060072eb0 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.873+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6050001bb0 con 0x7f6060072eb0 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.873+0000 7f6056ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.873+0000 7f6056ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:34.878 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.873+0000 7f6056ffd640 10 monclient(hunting): dump: 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:34.879 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:34.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T14:59:34.857+0000 10255640 -1 osd.1 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.875+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2421010384 0 0) 0x7f6060145250 con 0x7f6060146db0 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.875+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6040004eb0 con 0x7f6060146db0 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.875+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6058001bb0 con 0x7f6060146db0 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.875+0000 7f6056ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.875+0000 7f6056ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.875+0000 7f6056ffd640 10 monclient(hunting): dump: 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:34.883 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2954604696 0 0) 0x7f6060144fe0 con 0x7f6060072eb0 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 >> v1:172.21.15.38:6790/0 conn(0x7f60601404c0 legacy=0x7f6060138d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 >> v1:172.21.15.38:6789/0 conn(0x7f6060146db0 legacy=0x7f60601e3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 1 monclient: found mon.b 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:34.884 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60601462a0 con 0x7f6060072eb0 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f6056ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f60649c4640 5 monclient: authenticate success, global_id 4252 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f60649c4640 10 monclient: _renew_subs 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f60649c4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f60601459c0 con 0x7f6060072eb0 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f60649c4640 10 client.4252.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f60649c4640 10 monclient: _renew_subs 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f60649c4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6060141890 con 0x7f6060072eb0 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.877+0000 7f60649c4640 1 librados: init done 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.879+0000 7f60649c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:34.885 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.879+0000 7f60649c4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:34.886 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.879+0000 7f60649c4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:34.886 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.879+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6060145b90 con 0x7f6060072eb0 2024-04-15T14:59:34.898 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.897+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6050001a00 con 0x7f6060072eb0 2024-04-15T14:59:34.898 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.897+0000 7f6056ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.897+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6050005040 con 0x7f6060072eb0 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.897+0000 7f6056ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.897+0000 7f6056ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.897+0000 7f6056ffd640 10 monclient: dump: 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:34.899 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:34.900 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.897+0000 7f605d59a640 4 set_mon_vals no callback set 2024-04-15T14:59:34.900 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.899+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 4) ==== 90949+0+0 (unknown 3427149683 0 0) 0x7f605001b530 con 0x7f6060072eb0 2024-04-15T14:59:34.900 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T14:59:34.879+0000 10255640 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T14:59:34.901 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.899+0000 7f6057fff640 10 monclient: get_auth_request con 0x7f604006ee00 auth_method 0 2024-04-15T14:59:34.901 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.899+0000 7f6056ffd640 10 client.4252.objecter ms_handle_connect 0x7f604006ee00 2024-04-15T14:59:34.901 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.900+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 2371+0+0 (unknown 2293276987 0 0) 0x7f6050085a50 con 0x7f6060072eb0 2024-04-15T14:59:34.901 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.900+0000 7f6056ffd640 10 client.4252.objecter ms_dispatch 0x7f6060000b90 osd_map(15..15 src has 1..15) 2024-04-15T14:59:34.901 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.900+0000 7f6056ffd640 3 client.4252.objecter handle_osd_map got epochs [15,15] > 0 2024-04-15T14:59:34.902 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.900+0000 7f6056ffd640 3 client.4252.objecter handle_osd_map decoding full epoch 15 2024-04-15T14:59:34.902 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:34.900+0000 7f6056ffd640 20 client.4252.objecter dump_active .. 0 homeless 2024-04-15T14:59:35.156 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.155+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f6060147220 con 0x7f6060072eb0 2024-04-15T14:59:35.156 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.155+0000 7f6056ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:35.156 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.155+0000 7f6056ffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:35.499 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.497+0000 7f60649c4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:35.499 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.498+0000 7f60649c4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:35.499 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.498+0000 7f60649c4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:35.499 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.498+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6060063620 con 0x7f6060072eb0 2024-04-15T14:59:35.518 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.517+0000 7f6056ffd640 1 -- 172.21.15.38:0/419507556 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+7814 (unknown 1054498076 0 1758488705) 0x7f6050055780 con 0x7f6060072eb0 2024-04-15T14:59:35.518 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.517+0000 7f6056ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:35.518 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.517+0000 7f6056ffd640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:35.518 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-15T14:59:35.518 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":16,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:59:35.074851+0000","last_up_change":"2024-04-15T14:59:35.074851+0000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6805","nonce":3048929997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6807","nonce":3048929997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6810","nonce":3048929997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6808","nonce":3048929997}]},"public_addr":"172.21.15.38:6805/3048929997","cluster_addr":"172.21.15.38:6807/3048929997","heartbeat_back_addr":"172.21.15.38:6810/3048929997","heartbeat_front_addr":"172.21.15.38:6808/3048929997","state":["exists","up"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6806","nonce":3103013511}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6809","nonce":3103013511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6812","nonce":3103013511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6811","nonce":3103013511}]},"public_addr":"172.21.15.38:6806/3103013511","cluster_addr":"172.21.15.38:6809/3103013511","heartbeat_back_addr":"172.21.15.38:6812/3103013511","heartbeat_front_addr":"172.21.15.38:6811/3103013511","state":["exists","up"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6808","nonce":3078148286}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6809","nonce":3078148286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6811","nonce":3078148286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6810","nonce":3078148286}]},"public_addr":"172.21.15.164:6808/3078148286","cluster_addr":"172.21.15.164:6809/3078148286","heartbeat_back_addr":"172.21.15.164:6811/3078148286","heartbeat_front_addr":"172.21.15.164:6810/3078148286","state":["exists","up"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.842035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 10 librados: watch_flush enter 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 10 librados: watch_flush exit 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 20 client.4252.objecter shutdown clearing up homeless session... 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 10 client.4252.objecter successfully canceled tick 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 >> v1:172.21.15.38:6800/1608957829 conn(0x7f604006ee00 legacy=0x7f60400712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 10 monclient: shutdown 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 >> v1:172.21.15.164:6789/0 conn(0x7f6060072eb0 legacy=0x7f6060140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 shutdown_connections 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.519+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 >> 172.21.15.38:0/419507556 conn(0x7f60600b8c50 msgr2=0x7f60600b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.520+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 shutdown_connections 2024-04-15T14:59:35.521 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.520+0000 7f60649c4640 1 -- 172.21.15.38:0/419507556 wait complete. 2024-04-15T14:59:35.522 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:35.520+0000 7f60649c4640 1 librados: shutdown 2024-04-15T14:59:35.531 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-04-15T14:59:37.725 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:37.718+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:37.851 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:37.806+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:37.851 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:37.827+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:37.851 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:37.838+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:37.927 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:37.849+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:37.928 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:37.860+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:37.929 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:37.925+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:38.162 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:38.033+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:38.163 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:38.045+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:38.257 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:38.164+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:38.521 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:38.256+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:38.684 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:38.401+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-04-15T14:59:38.689 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:38.650+0000 5dc3480 -1 bdev(0x17a7a2b0 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 2 2024-04-15T14:59:39.056 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.010+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2024-04-15T14:59:39.057 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.043+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:39.139 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-15T14:59:39.131+0000 5dc3480 -1 bdev(0x15966310 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2024-04-15T14:59:39.344 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.055+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:39.344 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.162+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:39.344 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.233+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:39.345 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.244+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:39.528 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.346+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:39.529 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.492+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:39.586 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:39.580+0000 b47a640 -1 osd.4 0 waiting for initial osdmap 2024-04-15T14:59:39.651 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.528+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2024-04-15T14:59:39.655 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.558+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:39.828 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-15T14:59:39.326+0000 5dc3480 -1 bdev(0x15966310 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2024-04-15T14:59:40.032 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.653+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:40.032 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:39.675+0000 5dc3480 -1 bdev(0x17a77470 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2024-04-15T14:59:40.071 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T14:59:40.056+0000 1425d640 -1 osd.4 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T14:59:40.853 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:40.847+0000 bc8e640 -1 osd.5 0 waiting for initial osdmap 2024-04-15T14:59:40.917 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-15T14:59:40.912+0000 bc8e640 -1 osd.7 0 waiting for initial osdmap 2024-04-15T14:59:41.376 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T14:59:41.361+0000 1425d640 -1 osd.5 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T14:59:41.406 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-15T14:59:41.391+0000 1425d640 -1 osd.7 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T14:59:41.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.609+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.622+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.644+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.758 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.679+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.760 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.691+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.760 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.735+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.760 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.746+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.825 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.759+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.861 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.824+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.861 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.849+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:41.899 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.860+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.027 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.901+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.134 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:41.989+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.322 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.026+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2024-04-15T14:59:42.322 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.252+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.324 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.321+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.337 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T14:59:42.397 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.392+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2024-04-15T14:59:42.420 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.409+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.461 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.460+0000 7f220b504640 10 monclient: get_monmap_and_config 2024-04-15T14:59:42.461 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.460+0000 7f220b504640 10 monclient: build_initial_monmap 2024-04-15T14:59:42.461 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.460+0000 7f220b504640 10 monclient: monmap: 2024-04-15T14:59:42.461 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:42.461 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:42.462 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:59:42.460963+0000 2024-04-15T14:59:42.462 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:59:42.460963+0000 2024-04-15T14:59:42.462 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:42.462 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:42.462 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:42.462 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:42.462 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:42.462 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:42.467 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.460+0000 7f220b504640 1 Processor -- start 2024-04-15T14:59:42.467 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 1 -- start start 2024-04-15T14:59:42.467 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 10 monclient: init 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 10 monclient(hunting): picked mon.noname-c con 0x7f2204072eb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 10 monclient(hunting): picked mon.noname-a con 0x7f22041404c0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 10 monclient(hunting): picked mon.noname-b con 0x7f2204146db0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2204147220 con 0x7f22041404c0 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22040ab220 con 0x7f2204072eb0 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22040aad00 con 0x7f2204146db0 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.461+0000 7f220b504640 10 monclient(hunting): authenticate will time out at 1442.732348s 2024-04-15T14:59:42.468 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.462+0000 7f22092a0640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f2204072eb0 0x7f22040aa4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:59622/0 (socket says 172.21.15.38:59622) 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.462+0000 7f22092a0640 1 -- 172.21.15.38:0/2159356266 learned_addr learned my addr 172.21.15.38:0/2159356266 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004836730 0 0) 0x7f22040ab220 con 0x7f2204072eb0 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 10 monclient(hunting): my global_id is 4261 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21f0003520 con 0x7f2204072eb0 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031990273 0 0) 0x7f22040aad00 con 0x7f2204146db0 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 10 monclient(hunting): my global_id is 54173 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.465+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22040ab220 con 0x7f2204146db0 2024-04-15T14:59:42.469 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.466+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671464009 0 0) 0x7f21f4001110 con 0x7f22041404c0 2024-04-15T14:59:42.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.466+0000 7f21fbfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:42.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.466+0000 7f21fbfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:42.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.466+0000 7f21fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:42.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.466+0000 7f21fbfff640 10 monclient(hunting): my global_id is 4272 2024-04-15T14:59:42.470 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.466+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22040aad00 con 0x7f22041404c0 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3367524465 0 0) 0x7f21f0003520 con 0x7f2204072eb0 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 >> v1:172.21.15.38:6790/0 conn(0x7f2204146db0 legacy=0x7f220414ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 >> v1:172.21.15.38:6789/0 conn(0x7f22041404c0 legacy=0x7f22041466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 1 monclient: found mon.noname-c 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22040b5470 con 0x7f2204072eb0 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 10 monclient: _finish_auth 0 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:42.471 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2200001610 con 0x7f2204072eb0 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f21fbfff640 10 monclient: dump: 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f220b504640 5 monclient: authenticate success, global_id 4261 2024-04-15T14:59:42.472 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.470+0000 7f220b504640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:42.475 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.474+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2200001870 con 0x7f2204072eb0 2024-04-15T14:59:42.475 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.474+0000 7f21fbfff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:42.475 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.474+0000 7f21fbfff640 1 -- 172.21.15.38:0/2159356266 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2200001bc0 con 0x7f2204072eb0 2024-04-15T14:59:42.475 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.474+0000 7f21fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.474+0000 7f21fbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.474+0000 7f21fbfff640 10 monclient: dump: 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.474+0000 7f220b504640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:42.476 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.474+0000 7f220b504640 4 set_mon_vals no callback set 2024-04-15T14:59:42.478 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.475+0000 7f220b504640 10 monclient: shutdown 2024-04-15T14:59:42.478 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.475+0000 7f220b504640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.475+0000 7f220b504640 1 -- 172.21.15.38:0/2159356266 >> v1:172.21.15.164:6789/0 conn(0x7f2204072eb0 legacy=0x7f22040aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.475+0000 7f220b504640 1 -- 172.21.15.38:0/2159356266 shutdown_connections 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.475+0000 7f220b504640 1 -- 172.21.15.38:0/2159356266 >> 172.21.15.38:0/2159356266 conn(0x7f22040b8c50 msgr2=0x7f22040b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.476+0000 7f220b504640 1 -- 172.21.15.38:0/2159356266 shutdown_connections 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.476+0000 7f220b504640 1 -- 172.21.15.38:0/2159356266 wait complete. 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.476+0000 7f220b504640 10 monclient: build_initial_monmap 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.476+0000 7f220b504640 10 monclient: monmap: 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:created 0.000000 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:42.479 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.476+0000 7f220b504640 1 librados: starting msgr at 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.476+0000 7f220b504640 1 librados: starting objecter 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 1 Processor -- start 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 1 -- start start 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 1 librados: setting wanted keys 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 1 librados: calling monclient init 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 10 monclient: init 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 10 monclient(hunting): picked mon.noname-b con 0x7f2204072eb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:42.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 10 monclient(hunting): picked mon.noname-a con 0x7f22041404c0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:42.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 10 monclient(hunting): picked mon.noname-c con 0x7f2204146db0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:42.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22040702e0 con 0x7f22041404c0 2024-04-15T14:59:42.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220406e090 con 0x7f2204072eb0 2024-04-15T14:59:42.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220406dbd0 con 0x7f2204146db0 2024-04-15T14:59:42.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:42.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.477+0000 7f220b504640 10 monclient(hunting): authenticate will time out at 1442.748267s 2024-04-15T14:59:42.482 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.478+0000 7f2208a9f640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f22041404c0 0x7f22041421f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:48066/0 (socket says 172.21.15.38:48066) 2024-04-15T14:59:42.482 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.478+0000 7f2208a9f640 1 -- 172.21.15.38:0/1226560941 learned_addr learned my addr 172.21.15.38:0/1226560941 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:42.482 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.479+0000 7f21f9ffb640 10 client.?.objecter ms_handle_connect 0x7f22041404c0 2024-04-15T14:59:42.482 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.479+0000 7f21f9ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:42.482 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.479+0000 7f21f9ffb640 10 client.?.objecter ms_handle_connect 0x7f2204146db0 2024-04-15T14:59:42.482 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.479+0000 7f21f9ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:42.482 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.480+0000 7f21f9ffb640 10 client.?.objecter ms_handle_connect 0x7f2204072eb0 2024-04-15T14:59:42.483 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.480+0000 7f21f9ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:42.483 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556980264 0 0) 0x7f220406dbd0 con 0x7f2204146db0 2024-04-15T14:59:42.483 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:42.483 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:42.484 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:42.484 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 10 monclient(hunting): my global_id is 54176 2024-04-15T14:59:42.484 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21e8004eb0 con 0x7f2204146db0 2024-04-15T14:59:42.484 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267872276 0 0) 0x7f220406e090 con 0x7f2204072eb0 2024-04-15T14:59:42.484 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:42.484 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:42.484 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:42.484 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 10 monclient(hunting): my global_id is 4264 2024-04-15T14:59:42.484 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.482+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f220406dbd0 con 0x7f2204072eb0 2024-04-15T14:59:42.485 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.484+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091813734 0 0) 0x7f22040702e0 con 0x7f22041404c0 2024-04-15T14:59:42.485 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.484+0000 7f21f9ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:42.485 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.484+0000 7f21f9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:42.485 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.484+0000 7f21f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:42.485 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.484+0000 7f21f9ffb640 10 monclient(hunting): my global_id is 4275 2024-04-15T14:59:42.485 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.484+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f220406e090 con 0x7f22041404c0 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.489+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 772639951 0 0) 0x7f220406dbd0 con 0x7f2204072eb0 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.489+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22040702e0 con 0x7f2204072eb0 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.489+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2200001510 con 0x7f2204072eb0 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.489+0000 7f21f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.489+0000 7f21f9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.489+0000 7f21f9ffb640 10 monclient(hunting): dump: 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.490 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.489+0000 7f21f9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.490+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1260641874 0 0) 0x7f21e8004eb0 con 0x7f2204146db0 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.490+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f220406dbd0 con 0x7f2204146db0 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.490+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f21fc001b50 con 0x7f2204146db0 2024-04-15T14:59:42.491 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.490+0000 7f21f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.490+0000 7f21f9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.490+0000 7f21f9ffb640 10 monclient(hunting): dump: 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:42.492 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2739004531 0 0) 0x7f22040702e0 con 0x7f2204072eb0 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 >> v1:172.21.15.38:6790/0 conn(0x7f2204146db0 legacy=0x7f2204142900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 >> v1:172.21.15.38:6789/0 conn(0x7f22041404c0 legacy=0x7f22041421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 10 monclient: _finish_hunting 0 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 1 monclient: found mon.b 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220406f3f0 con 0x7f2204072eb0 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 10 monclient: _finish_auth 0 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 10 monclient: _check_auth_tickets 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f21f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f220b504640 5 monclient: authenticate success, global_id 4264 2024-04-15T14:59:42.495 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f220b504640 10 monclient: _renew_subs 2024-04-15T14:59:42.496 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f220b504640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:42.496 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f22041e8b20 con 0x7f2204072eb0 2024-04-15T14:59:42.496 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f220b504640 10 client.4264.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:42.496 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f220b504640 10 monclient: _renew_subs 2024-04-15T14:59:42.496 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f220b504640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:42.496 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f22041e8ed0 con 0x7f2204072eb0 2024-04-15T14:59:42.496 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.493+0000 7f220b504640 1 librados: init done 2024-04-15T14:59:42.497 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.495+0000 7f220b504640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:42.497 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.495+0000 7f220b504640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:42.497 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.495+0000 7f220b504640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:42.497 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.495+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2204063620 con 0x7f2204072eb0 2024-04-15T14:59:42.501 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.500+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22000011b0 con 0x7f2204072eb0 2024-04-15T14:59:42.501 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.500+0000 7f21f9ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:42.502 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.500+0000 7f21fb7fe640 4 set_mon_vals no callback set 2024-04-15T14:59:42.509 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.508+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2200004a90 con 0x7f2204072eb0 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.508+0000 7f21f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.508+0000 7f21f9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.508+0000 7f21f9ffb640 10 monclient: dump: 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:42.510 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:42.511 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:42.511 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.509+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 4) ==== 90949+0+0 (unknown 3427149683 0 0) 0x7f220001af80 con 0x7f2204072eb0 2024-04-15T14:59:42.511 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.510+0000 7f2208a9f640 10 monclient: get_auth_request con 0x7f21e806eda0 auth_method 0 2024-04-15T14:59:42.511 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.510+0000 7f21f9ffb640 10 client.4264.objecter ms_handle_connect 0x7f21e806eda0 2024-04-15T14:59:42.512 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.421+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.465+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.479+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.512+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:42.618+0000 5dc3480 -1 bdev(0x17e71190 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-04-15T14:59:42.767 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.766+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3457+0+0 (unknown 3432040099 0 0) 0x7f2200053380 con 0x7f2204072eb0 2024-04-15T14:59:42.768 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.766+0000 7f21f9ffb640 10 client.4264.objecter ms_dispatch 0x7f2204000b90 osd_map(21..21 src has 1..21) 2024-04-15T14:59:42.768 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.766+0000 7f21f9ffb640 3 client.4264.objecter handle_osd_map got epochs [21,21] > 0 2024-04-15T14:59:42.768 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.766+0000 7f21f9ffb640 3 client.4264.objecter handle_osd_map decoding full epoch 21 2024-04-15T14:59:42.768 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.766+0000 7f21f9ffb640 20 client.4264.objecter dump_active .. 0 homeless 2024-04-15T14:59:42.771 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.770+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f2200055780 con 0x7f2204072eb0 2024-04-15T14:59:42.771 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.770+0000 7f21f9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:42.771 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.770+0000 7f21f9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:42.771 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:42.731+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-04-15T14:59:42.818 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:42.771+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-04-15T14:59:42.915 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:42.793+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-04-15T14:59:42.968 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:42.817+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-04-15T14:59:42.968 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.967+0000 7f220b504640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:42.969 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.967+0000 7f220b504640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:42.969 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.967+0000 7f220b504640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:42.969 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:42.967+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2204075fb0 con 0x7f2204072eb0 2024-04-15T14:59:42.979 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:42.916+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-04-15T14:59:43.056 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.055+0000 7f21f9ffb640 1 -- 172.21.15.38:0/1226560941 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+10392 (unknown 898900276 0 2705430050) 0x7f2200055080 con 0x7f2204072eb0 2024-04-15T14:59:43.056 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.055+0000 7f21f9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:43.056 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.055+0000 7f21f9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:43.056 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-15T14:59:43.056 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":21,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:59:42.109930+0000","last_up_change":"2024-04-15T14:59:42.109930+0000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T14:59:35.434715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6805","nonce":3048929997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6807","nonce":3048929997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6810","nonce":3048929997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6808","nonce":3048929997}]},"public_addr":"172.21.15.38:6805/3048929997","cluster_addr":"172.21.15.38:6807/3048929997","heartbeat_back_addr":"172.21.15.38:6810/3048929997","heartbeat_front_addr":"172.21.15.38:6808/3048929997","state":["exists","up"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6806","nonce":3103013511}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6809","nonce":3103013511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6812","nonce":3103013511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6811","nonce":3103013511}]},"public_addr":"172.21.15.38:6806/3103013511","cluster_addr":"172.21.15.38:6809/3103013511","heartbeat_back_addr":"172.21.15.38:6812/3103013511","heartbeat_front_addr":"172.21.15.38:6811/3103013511","state":["exists","up"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6812","nonce":1135451953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6813","nonce":1135451953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6815","nonce":1135451953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6814","nonce":1135451953}]},"public_addr":"172.21.15.164:6812/1135451953","cluster_addr":"172.21.15.164:6813/1135451953","heartbeat_back_addr":"172.21.15.164:6815/1135451953","heartbeat_front_addr":"172.21.15.164:6814/1135451953","state":["exists","up"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6804","nonce":350713352}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6805","nonce":350713352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6807","nonce":350713352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6806","nonce":350713352}]},"public_addr":"172.21.15.164:6804/350713352","cluster_addr":"172.21.15.164:6805/350713352","heartbeat_back_addr":"172.21.15.164:6807/350713352","heartbeat_front_addr":"172.21.15.164:6806/350713352","state":["exists","up"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6808","nonce":3078148286}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6809","nonce":3078148286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6811","nonce":3078148286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6810","nonce":3078148286}]},"public_addr":"172.21.15.164:6808/3078148286","cluster_addr":"172.21.15.164:6809/3078148286","heartbeat_back_addr":"172.21.15.164:6811/3078148286","heartbeat_front_addr":"172.21.15.164:6810/3078148286","state":["exists","up"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6800","nonce":3353977755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6801","nonce":3353977755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6803","nonce":3353977755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6802","nonce":3353977755}]},"public_addr":"172.21.15.164:6800/3353977755","cluster_addr":"172.21.15.164:6801/3353977755","heartbeat_back_addr":"172.21.15.164:6803/3353977755","heartbeat_front_addr":"172.21.15.164:6802/3353977755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.779245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.754228+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:30.038226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.842035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:59:43.059 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.057+0000 7f220b504640 10 librados: watch_flush enter 2024-04-15T14:59:43.059 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.057+0000 7f220b504640 10 librados: watch_flush exit 2024-04-15T14:59:43.059 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.057+0000 7f220b504640 20 client.4264.objecter shutdown clearing up homeless session... 2024-04-15T14:59:43.059 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.057+0000 7f220b504640 10 client.4264.objecter successfully canceled tick 2024-04-15T14:59:43.059 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.058+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 >> v1:172.21.15.38:6800/1608957829 conn(0x7f21e806eda0 legacy=0x7f21e8071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:43.059 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.058+0000 7f220b504640 10 monclient: shutdown 2024-04-15T14:59:43.059 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.058+0000 7f220b504640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:43.059 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.058+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 >> v1:172.21.15.164:6789/0 conn(0x7f2204072eb0 legacy=0x7f220406ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:43.059 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.058+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 shutdown_connections 2024-04-15T14:59:43.060 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.058+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 >> 172.21.15.38:0/1226560941 conn(0x7f22040b8c50 msgr2=0x7f220413f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:43.060 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.058+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 shutdown_connections 2024-04-15T14:59:43.060 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.058+0000 7f220b504640 1 -- 172.21.15.38:0/1226560941 wait complete. 2024-04-15T14:59:43.060 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:43.058+0000 7f220b504640 1 librados: shutdown 2024-04-15T14:59:43.070 DEBUG:teuthology.misc:6 of 8 OSDs are up 2024-04-15T14:59:43.226 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:42.967+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-04-15T14:59:43.227 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:43.052+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 2 2024-04-15T14:59:43.239 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:43.226+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-04-15T14:59:43.259 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:43.238+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-04-15T14:59:43.584 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:43.579+0000 bc8e640 -1 osd.3 0 waiting for initial osdmap 2024-04-15T14:59:43.817 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:43.411+0000 5dc3480 -1 bdev(0x17a7c1f0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-04-15T14:59:44.180 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T14:59:44.162+0000 1425d640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T14:59:44.748 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:44.742+0000 b47a640 -1 osd.2 0 waiting for initial osdmap 2024-04-15T14:59:45.276 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T14:59:45.260+0000 1425d640 -1 osd.2 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T14:59:46.665 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:01:24.508 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T14:59:46.737 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:01:24.527 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T14:59:46.740 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:01:24.584 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T14:59:46.780 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:01:24.624 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T14:59:46.791 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:01:24.580 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T14:59:46.836 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:01:24.679 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T14:59:47.005 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:01:24.848 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T14:59:47.022 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:01:24.813 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T14:59:47.089 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:01:24.932 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T14:59:49.877 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T14:59:49.982 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.980+0000 7fda4ddd4640 10 monclient: get_monmap_and_config 2024-04-15T14:59:49.982 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.980+0000 7fda4ddd4640 10 monclient: build_initial_monmap 2024-04-15T14:59:49.982 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.980+0000 7fda4ddd4640 10 monclient: monmap: 2024-04-15T14:59:49.982 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:49.982 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:49.982 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:59:49.981865+0000 2024-04-15T14:59:49.982 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:59:49.981865+0000 2024-04-15T14:59:49.982 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:49.983 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:49.983 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:49.983 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:49.983 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:49.983 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:49.984 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.980+0000 7fda4ddd4640 1 Processor -- start 2024-04-15T14:59:49.984 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.980+0000 7fda4ddd4640 1 -- start start 2024-04-15T14:59:49.984 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.980+0000 7fda4ddd4640 10 monclient: init 2024-04-15T14:59:49.984 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:49.984 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:49.984 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 10 monclient(hunting): picked mon.noname-a con 0x7fda48072eb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:49.984 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 10 monclient(hunting): picked mon.noname-c con 0x7fda481404c0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:49.984 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 10 monclient(hunting): picked mon.noname-b con 0x7fda48146db0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:49.985 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda48147220 con 0x7fda48072eb0 2024-04-15T14:59:49.985 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda480ab220 con 0x7fda481404c0 2024-04-15T14:59:49.985 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda480aad00 con 0x7fda48146db0 2024-04-15T14:59:49.985 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:49.985 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.981+0000 7fda4ddd4640 10 monclient(hunting): authenticate will time out at 1450.253030s 2024-04-15T14:59:49.985 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.982+0000 7fda47fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fda48146db0 0x7fda4814ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56644/0 (socket says 172.21.15.38:56644) 2024-04-15T14:59:49.985 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.982+0000 7fda47fff640 1 -- 172.21.15.38:0/442497512 learned_addr learned my addr 172.21.15.38:0/442497512 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:49.986 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.984+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295677617 0 0) 0x7fda38001490 con 0x7fda48072eb0 2024-04-15T14:59:49.986 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.984+0000 7fda467fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:49.986 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.984+0000 7fda467fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:49.986 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.984+0000 7fda467fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:49.986 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.984+0000 7fda467fc640 10 monclient(hunting): my global_id is 4281 2024-04-15T14:59:49.986 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.984+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda30003520 con 0x7fda48072eb0 2024-04-15T14:59:49.987 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.985+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080027402 0 0) 0x7fda480aad00 con 0x7fda48146db0 2024-04-15T14:59:49.987 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.985+0000 7fda467fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:49.987 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.985+0000 7fda467fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:49.987 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.985+0000 7fda467fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:49.987 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.985+0000 7fda467fc640 10 monclient(hunting): my global_id is 54182 2024-04-15T14:59:49.987 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.985+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda38001490 con 0x7fda48146db0 2024-04-15T14:59:49.988 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.986+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364513415 0 0) 0x7fda480ab220 con 0x7fda481404c0 2024-04-15T14:59:49.988 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.986+0000 7fda467fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:49.988 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.986+0000 7fda467fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:49.988 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.986+0000 7fda467fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:49.988 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.986+0000 7fda467fc640 10 monclient(hunting): my global_id is 4270 2024-04-15T14:59:49.988 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.986+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda480aad00 con 0x7fda481404c0 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 382361901 0 0) 0x7fda38001490 con 0x7fda48146db0 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 >> v1:172.21.15.164:6789/0 conn(0x7fda481404c0 legacy=0x7fda481466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 >> v1:172.21.15.38:6789/0 conn(0x7fda48072eb0 legacy=0x7fda480aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 1 monclient: found mon.noname-b 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda480b5470 con 0x7fda48146db0 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda400015f0 con 0x7fda48146db0 2024-04-15T14:59:49.991 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda4ddd4640 5 monclient: authenticate success, global_id 54182 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda4ddd4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda467fc640 10 monclient: dump: 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:49.992 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.988+0000 7fda4ddd4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:49.993 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda40001850 con 0x7fda48146db0 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda467fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda467fc640 1 -- 172.21.15.38:0/442497512 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda40001c20 con 0x7fda48146db0 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda4ddd4640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda4ddd4640 4 set_mon_vals no callback set 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda467fc640 10 monclient: dump: 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:49.994 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda4ddd4640 10 monclient: shutdown 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda4ddd4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda4ddd4640 1 -- 172.21.15.38:0/442497512 >> v1:172.21.15.38:6790/0 conn(0x7fda48146db0 legacy=0x7fda4814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda4ddd4640 1 -- 172.21.15.38:0/442497512 shutdown_connections 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.991+0000 7fda4ddd4640 1 -- 172.21.15.38:0/442497512 >> 172.21.15.38:0/442497512 conn(0x7fda480b8c50 msgr2=0x7fda480b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.992+0000 7fda4ddd4640 1 -- 172.21.15.38:0/442497512 shutdown_connections 2024-04-15T14:59:49.995 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.992+0000 7fda4ddd4640 1 -- 172.21.15.38:0/442497512 wait complete. 2024-04-15T14:59:49.997 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.992+0000 7fda4ddd4640 10 monclient: build_initial_monmap 2024-04-15T14:59:49.997 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.992+0000 7fda4ddd4640 10 monclient: monmap: 2024-04-15T14:59:49.997 INFO:teuthology.misc.health.smithi038.stderr:epoch 0 2024-04-15T14:59:49.997 INFO:teuthology.misc.health.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:49.997 INFO:teuthology.misc.health.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:49.997 INFO:teuthology.misc.health.smithi038.stderr:created 0.000000 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.992+0000 7fda4ddd4640 1 librados: starting msgr at 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.992+0000 7fda4ddd4640 1 librados: starting objecter 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 1 Processor -- start 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 1 -- start start 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 1 librados: setting wanted keys 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 1 librados: calling monclient init 2024-04-15T14:59:49.998 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 10 monclient: init 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 10 monclient(hunting): picked mon.noname-c con 0x7fda48072eb0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 10 monclient(hunting): picked mon.noname-b con 0x7fda481404c0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 10 monclient(hunting): picked mon.noname-a con 0x7fda48146db0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda48139b00 con 0x7fda48146db0 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda48144180 con 0x7fda481404c0 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda48145180 con 0x7fda48072eb0 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.993+0000 7fda4ddd4640 10 monclient(hunting): authenticate will time out at 1450.265347s 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.994+0000 7fda477fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fda48072eb0 0x7fda48143a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56650/0 (socket says 172.21.15.38:56650) 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.994+0000 7fda477fe640 1 -- 172.21.15.38:0/1270512855 learned_addr learned my addr 172.21.15.38:0/1270512855 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.994+0000 7fda2ffff640 10 client.?.objecter ms_handle_connect 0x7fda48072eb0 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.994+0000 7fda2ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:49.999 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.994+0000 7fda2ffff640 10 client.?.objecter ms_handle_connect 0x7fda48146db0 2024-04-15T14:59:50.000 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.994+0000 7fda2ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:50.000 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.995+0000 7fda2ffff640 10 client.?.objecter ms_handle_connect 0x7fda481404c0 2024-04-15T14:59:50.000 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.995+0000 7fda2ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:50.000 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.996+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188494514 0 0) 0x7fda48145180 con 0x7fda48072eb0 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.996+0000 7fda2ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.996+0000 7fda2ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.996+0000 7fda2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.996+0000 7fda2ffff640 10 monclient(hunting): my global_id is 54185 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.996+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda34004eb0 con 0x7fda48072eb0 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504724396 0 0) 0x7fda48139b00 con 0x7fda48146db0 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 10 monclient(hunting): my global_id is 4284 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda48145180 con 0x7fda48146db0 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703772185 0 0) 0x7fda48144180 con 0x7fda481404c0 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:50.001 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:50.002 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:50.002 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 10 monclient(hunting): my global_id is 4273 2024-04-15T14:59:50.002 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:49.997+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda48139b00 con 0x7fda481404c0 2024-04-15T14:59:50.005 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.003+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2317002011 0 0) 0x7fda48139b00 con 0x7fda481404c0 2024-04-15T14:59:50.005 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.003+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda48144180 con 0x7fda481404c0 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.003+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda3c0018b0 con 0x7fda481404c0 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.003+0000 7fda2ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.003+0000 7fda2ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.003+0000 7fda2ffff640 10 monclient(hunting): dump: 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.006 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:50.007 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.003+0000 7fda2ffff640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 356710724 0 0) 0x7fda34004eb0 con 0x7fda48072eb0 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda48139b00 con 0x7fda48072eb0 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda38001780 con 0x7fda48072eb0 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 10 monclient(hunting): dump: 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.008 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2089328247 0 0) 0x7fda48145180 con 0x7fda48146db0 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda34004eb0 con 0x7fda48146db0 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda400014f0 con 0x7fda48146db0 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.004+0000 7fda2ffff640 10 monclient(hunting): dump: 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.009 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.010 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.010 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.010 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.010 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.010 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.010 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.010 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:50.011 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1801862418 0 0) 0x7fda48144180 con 0x7fda481404c0 2024-04-15T14:59:50.011 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 >> v1:172.21.15.38:6790/0 conn(0x7fda48072eb0 legacy=0x7fda48143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:50.011 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 >> v1:172.21.15.38:6789/0 conn(0x7fda48146db0 legacy=0x7fda481393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:50.011 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:50.011 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 1 monclient: found mon.b 2024-04-15T14:59:50.011 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:50.011 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.011 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda48145460 con 0x7fda481404c0 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 10 monclient: _finish_auth 0 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda4ddd4640 5 monclient: authenticate success, global_id 4273 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda4ddd4640 10 monclient: _renew_subs 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda4ddd4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda481434d0 con 0x7fda481404c0 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda4ddd4640 10 client.4273.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda4ddd4640 10 monclient: _renew_subs 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda4ddd4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fda481cfdd0 con 0x7fda481404c0 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.007+0000 7fda4ddd4640 1 librados: init done 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.008+0000 7fda4ddd4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.008+0000 7fda4ddd4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:50.012 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.008+0000 7fda4ddd4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.013 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.008+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda48063620 con 0x7fda481404c0 2024-04-15T14:59:50.265 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.263+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda3c003610 con 0x7fda481404c0 2024-04-15T14:59:50.265 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.263+0000 7fda2ffff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:50.265 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.263+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda3c003960 con 0x7fda481404c0 2024-04-15T14:59:50.265 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.263+0000 7fda2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:50.265 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.263+0000 7fda2ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:50.265 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.263+0000 7fda2ffff640 10 monclient: dump: 2024-04-15T14:59:50.265 INFO:teuthology.misc.health.smithi038.stderr:epoch 1 2024-04-15T14:59:50.265 INFO:teuthology.misc.health.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.265 INFO:teuthology.misc.health.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.266 INFO:teuthology.misc.health.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.266 INFO:teuthology.misc.health.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.266 INFO:teuthology.misc.health.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.266 INFO:teuthology.misc.health.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.266 INFO:teuthology.misc.health.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.266 INFO:teuthology.misc.health.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.266 INFO:teuthology.misc.health.smithi038.stderr: 2024-04-15T14:59:50.266 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.263+0000 7fda45ffb640 4 set_mon_vals no callback set 2024-04-15T14:59:50.267 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.263+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fda3c019e90 con 0x7fda481404c0 2024-04-15T14:59:50.267 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.264+0000 7fda477fe640 10 monclient: get_auth_request con 0x7fda3406ee60 auth_method 0 2024-04-15T14:59:50.267 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.264+0000 7fda2ffff640 10 client.4273.objecter ms_handle_connect 0x7fda3406ee60 2024-04-15T14:59:50.267 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.265+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 3737+0+0 (unknown 1860972177 0 0) 0x7fda3c052020 con 0x7fda481404c0 2024-04-15T14:59:50.267 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.265+0000 7fda2ffff640 10 client.4273.objecter ms_dispatch 0x7fda48000b90 osd_map(25..25 src has 1..25) 2024-04-15T14:59:50.267 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.265+0000 7fda2ffff640 3 client.4273.objecter handle_osd_map got epochs [25,25] > 0 2024-04-15T14:59:50.267 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.265+0000 7fda2ffff640 3 client.4273.objecter handle_osd_map decoding full epoch 25 2024-04-15T14:59:50.267 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.265+0000 7fda2ffff640 20 client.4273.objecter dump_active .. 0 homeless 2024-04-15T14:59:50.269 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.268+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fda3c054420 con 0x7fda481404c0 2024-04-15T14:59:50.270 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.268+0000 7fda2ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:50.270 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.268+0000 7fda2ffff640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:50.457 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.455+0000 7fda4ddd4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:50.458 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.455+0000 7fda4ddd4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:50.458 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.455+0000 7fda4ddd4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.458 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.455+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda48075fb0 con 0x7fda481404c0 2024-04-15T14:59:50.478 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.476+0000 7fda2ffff640 1 -- 172.21.15.38:0/1270512855 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+10952 (unknown 780366164 0 669995446) 0x7fda3c053d20 con 0x7fda481404c0 2024-04-15T14:59:50.478 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.476+0000 7fda2ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:50.478 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.476+0000 7fda2ffff640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:50.478 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-15T14:59:50.478 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":25,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:59:47.605950+0000","last_up_change":"2024-04-15T14:59:46.146485+0000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T14:59:35.434715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6805","nonce":3048929997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6807","nonce":3048929997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6810","nonce":3048929997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6808","nonce":3048929997}]},"public_addr":"172.21.15.38:6805/3048929997","cluster_addr":"172.21.15.38:6807/3048929997","heartbeat_back_addr":"172.21.15.38:6810/3048929997","heartbeat_front_addr":"172.21.15.38:6808/3048929997","state":["exists","up"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6806","nonce":3103013511}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6809","nonce":3103013511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6812","nonce":3103013511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6811","nonce":3103013511}]},"public_addr":"172.21.15.38:6806/3103013511","cluster_addr":"172.21.15.38:6809/3103013511","heartbeat_back_addr":"172.21.15.38:6812/3103013511","heartbeat_front_addr":"172.21.15.38:6811/3103013511","state":["exists","up"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6801","nonce":2505059545}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6802","nonce":2505059545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6804","nonce":2505059545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6803","nonce":2505059545}]},"public_addr":"172.21.15.38:6801/2505059545","cluster_addr":"172.21.15.38:6802/2505059545","heartbeat_back_addr":"172.21.15.38:6804/2505059545","heartbeat_front_addr":"172.21.15.38:6803/2505059545","state":["exists","up"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6813","nonce":2746933626}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6814","nonce":2746933626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6816","nonce":2746933626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6815","nonce":2746933626}]},"public_addr":"172.21.15.38:6813/2746933626","cluster_addr":"172.21.15.38:6814/2746933626","heartbeat_back_addr":"172.21.15.38:6816/2746933626","heartbeat_front_addr":"172.21.15.38:6815/2746933626","state":["exists","up"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6812","nonce":1135451953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6813","nonce":1135451953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6815","nonce":1135451953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6814","nonce":1135451953}]},"public_addr":"172.21.15.164:6812/1135451953","cluster_addr":"172.21.15.164:6813/1135451953","heartbeat_back_addr":"172.21.15.164:6815/1135451953","heartbeat_front_addr":"172.21.15.164:6814/1135451953","state":["exists","up"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6804","nonce":350713352}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6805","nonce":350713352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6807","nonce":350713352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6806","nonce":350713352}]},"public_addr":"172.21.15.164:6804/350713352","cluster_addr":"172.21.15.164:6805/350713352","heartbeat_back_addr":"172.21.15.164:6807/350713352","heartbeat_front_addr":"172.21.15.164:6806/350713352","state":["exists","up"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6808","nonce":3078148286}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6809","nonce":3078148286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6811","nonce":3078148286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6810","nonce":3078148286}]},"public_addr":"172.21.15.164:6808/3078148286","cluster_addr":"172.21.15.164:6809/3078148286","heartbeat_back_addr":"172.21.15.164:6811/3078148286","heartbeat_front_addr":"172.21.15.164:6810/3078148286","state":["exists","up"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6800","nonce":3353977755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6801","nonce":3353977755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6803","nonce":3353977755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6802","nonce":3353977755}]},"public_addr":"172.21.15.164:6800/3353977755","cluster_addr":"172.21.15.164:6801/3353977755","heartbeat_back_addr":"172.21.15.164:6803/3353977755","heartbeat_front_addr":"172.21.15.164:6802/3353977755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.779245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.754228+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.720273+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.101812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:30.038226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:30.010400+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.842035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.987364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:59:50.480 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 10 librados: watch_flush enter 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 10 librados: watch_flush exit 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 20 client.4273.objecter shutdown clearing up homeless session... 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 10 client.4273.objecter successfully canceled tick 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 >> v1:172.21.15.38:6800/1608957829 conn(0x7fda3406ee60 legacy=0x7fda34071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 10 monclient: shutdown 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 >> v1:172.21.15.164:6789/0 conn(0x7fda481404c0 legacy=0x7fda48138ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 shutdown_connections 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 >> 172.21.15.38:0/1270512855 conn(0x7fda480b8c50 msgr2=0x7fda480b8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 shutdown_connections 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 1 -- 172.21.15.38:0/1270512855 wait complete. 2024-04-15T14:59:50.481 INFO:teuthology.misc.health.smithi038.stderr:2024-04-15T14:59:50.478+0000 7fda4ddd4640 1 librados: shutdown 2024-04-15T14:59:50.490 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-15T14:59:50.490 INFO:tasks.ceph:Creating RBD pool 2024-04-15T14:59:50.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.591+0000 7f0494026640 10 monclient: get_monmap_and_config 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.591+0000 7f0494026640 10 monclient: build_initial_monmap 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.591+0000 7f0494026640 10 monclient: monmap: 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:50.592836+0000 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:50.592836+0000 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.593 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:50.594 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:50.594 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:50.594 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:50.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.591+0000 7f0494026640 1 Processor -- start 2024-04-15T14:59:50.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.591+0000 7f0494026640 1 -- start start 2024-04-15T14:59:50.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.591+0000 7f0494026640 10 monclient: init 2024-04-15T14:59:50.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:50.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:50.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 10 monclient(hunting): picked mon.noname-a con 0x7f048c0b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:50.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 10 monclient(hunting): picked mon.noname-c con 0x7f048c0b5bb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:50.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 10 monclient(hunting): picked mon.noname-b con 0x7f048c140b30 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:50.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c146e10 con 0x7f048c0b57d0 2024-04-15T14:59:50.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c0aa840 con 0x7f048c0b5bb0 2024-04-15T14:59:50.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c0aa460 con 0x7f048c140b30 2024-04-15T14:59:50.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:50.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f0494026640 10 monclient(hunting): authenticate will time out at 1450.863928s 2024-04-15T14:59:50.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f04925c3640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f048c140b30 0x7f048c14ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56656/0 (socket says 172.21.15.38:56656) 2024-04-15T14:59:50.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.592+0000 7f04925c3640 1 -- 172.21.15.38:0/3138901397 learned_addr learned my addr 172.21.15.38:0/3138901397 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:50.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920400331 0 0) 0x7f048c0aa840 con 0x7f048c0b5bb0 2024-04-15T14:59:50.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): _negotiate 2024-04-15T14:59:50.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:50.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): my global_id is 4276 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0474003520 con 0x7f048c0b5bb0 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010206091 0 0) 0x7f048c0aa460 con 0x7f048c140b30 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): _negotiate 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): my global_id is 54188 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f048c0aa840 con 0x7f048c140b30 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 932398998 0 0) 0x7f048c146e10 con 0x7f048c0b57d0 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): _negotiate 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 10 monclient(hunting): my global_id is 4287 2024-04-15T14:59:50.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.595+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f048c0aa460 con 0x7f048c0b57d0 2024-04-15T14:59:50.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982673457 0 0) 0x7f0474003520 con 0x7f048c0b5bb0 2024-04-15T14:59:50.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 >> v1:172.21.15.38:6790/0 conn(0x7f048c140b30 legacy=0x7f048c14ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:50.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 >> v1:172.21.15.38:6789/0 conn(0x7f048c0b57d0 legacy=0x7f048c146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 10 monclient: _finish_hunting 0 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 1 monclient: found mon.noname-c 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c0b2970 con 0x7f048c0b5bb0 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 10 monclient: _finish_auth 0 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 10 monclient: _check_auth_tickets 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0494026640 5 monclient: authenticate success, global_id 4276 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0494026640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0480001610 con 0x7f048c0b5bb0 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0490dc0640 10 monclient: dump: 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.601 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.602 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.602 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.602 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.602 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.602 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.602 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.602 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:50.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.598+0000 7f0494026640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:50.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04800018a0 con 0x7f048c0b5bb0 2024-04-15T14:59:50.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0490dc0640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0490dc0640 1 -- 172.21.15.38:0/3138901397 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0480001c70 con 0x7f048c0b5bb0 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0494026640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0494026640 4 set_mon_vals no callback set 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0490dc0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0490dc0640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0490dc0640 10 monclient: dump: 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.604 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0494026640 10 monclient: shutdown 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0494026640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.600+0000 7f0494026640 1 -- 172.21.15.38:0/3138901397 >> v1:172.21.15.164:6789/0 conn(0x7f048c0b5bb0 legacy=0x7f048c140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.601+0000 7f0494026640 1 -- 172.21.15.38:0/3138901397 shutdown_connections 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.601+0000 7f0494026640 1 -- 172.21.15.38:0/3138901397 >> 172.21.15.38:0/3138901397 conn(0x7f048c067790 msgr2=0x7f048c067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.601+0000 7f0494026640 1 -- 172.21.15.38:0/3138901397 shutdown_connections 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.601+0000 7f0494026640 1 -- 172.21.15.38:0/3138901397 wait complete. 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.601+0000 7f0494026640 10 monclient: build_initial_monmap 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.601+0000 7f0494026640 10 monclient: monmap: 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:50.605 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 1 librados: starting msgr at 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 1 librados: starting objecter 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 1 Processor -- start 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 1 -- start start 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 1 librados: setting wanted keys 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 1 librados: calling monclient init 2024-04-15T14:59:50.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 10 monclient: init 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 10 monclient(hunting): picked mon.noname-b con 0x7f048c0b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 10 monclient(hunting): picked mon.noname-a con 0x7f048c0b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 10 monclient(hunting): picked mon.noname-c con 0x7f048c140b30 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c0ae950 con 0x7f048c0b5bb0 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c0b2690 con 0x7f048c0b57d0 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c0b2390 con 0x7f048c140b30 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:50.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.602+0000 7f0494026640 10 monclient(hunting): authenticate will time out at 1450.874294s 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.603+0000 7f04925c3640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f048c140b30 0x7f048c0b11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56658/0 (socket says 172.21.15.38:56658) 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.603+0000 7f04925c3640 1 -- 172.21.15.38:0/229708517 learned_addr learned my addr 172.21.15.38:0/229708517 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.603+0000 7f048a7fc640 10 client.?.objecter ms_handle_connect 0x7f048c140b30 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.603+0000 7f048a7fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.603+0000 7f048a7fc640 10 client.?.objecter ms_handle_connect 0x7f048c0b5bb0 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.603+0000 7f048a7fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.603+0000 7f048a7fc640 10 client.?.objecter ms_handle_connect 0x7f048c0b57d0 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.603+0000 7f048a7fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088605300 0 0) 0x7f048c0b2390 con 0x7f048c140b30 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): my global_id is 54191 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0478004eb0 con 0x7f048c140b30 2024-04-15T14:59:50.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487495220 0 0) 0x7f048c0b2690 con 0x7f048c0b57d0 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): my global_id is 4279 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f048c0b2390 con 0x7f048c0b57d0 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4094483282 0 0) 0x7f048c0ae950 con 0x7f048c0b5bb0 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 10 monclient(hunting): my global_id is 4290 2024-04-15T14:59:50.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.605+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f048c0b2690 con 0x7f048c0b5bb0 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2137061018 0 0) 0x7f048c0b2390 con 0x7f048c0b57d0 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f048c0ae950 con 0x7f048c0b57d0 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f047c001c30 con 0x7f048c0b57d0 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 10 monclient(hunting): dump: 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.613 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2210390670 0 0) 0x7f0478004eb0 con 0x7f048c140b30 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f048c0b2390 con 0x7f048c140b30 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 548447693 0 0) 0x7f048c0b2690 con 0x7f048c0b5bb0 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0478004eb0 con 0x7f048c0b5bb0 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0480001a50 con 0x7f048c0b5bb0 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.610+0000 7f048a7fc640 10 monclient(hunting): dump: 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.614 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.611+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f04840017f0 con 0x7f048c140b30 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.611+0000 7f048a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.611+0000 7f048a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.611+0000 7f048a7fc640 10 monclient(hunting): dump: 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.615 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.616 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.616 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.616 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1584085893 0 0) 0x7f048c0ae950 con 0x7f048c0b57d0 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 >> v1:172.21.15.38:6790/0 conn(0x7f048c140b30 legacy=0x7f048c0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 >> v1:172.21.15.38:6789/0 conn(0x7f048c0b5bb0 legacy=0x7f048c1d89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 1 monclient: found mon.b 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c144030 con 0x7f048c0b57d0 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f048a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f0494026640 5 monclient: authenticate success, global_id 4279 2024-04-15T14:59:50.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f0494026640 10 monclient: _renew_subs 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f0494026640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f048c0ac910 con 0x7f048c0b57d0 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f0494026640 10 client.4279.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f0494026640 10 monclient: _renew_subs 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f0494026640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f048c1d92e0 con 0x7f048c0b57d0 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.613+0000 7f0494026640 1 librados: init done 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.614+0000 7f0494026640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.614+0000 7f0494026640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.614+0000 7f0494026640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:50.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.614+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048c077050 con 0x7f048c0b57d0 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.628+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f047c003990 con 0x7f048c0b57d0 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.628+0000 7f048a7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.628+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f047c003ce0 con 0x7f048c0b57d0 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.628+0000 7f048a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.628+0000 7f048a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.628+0000 7f048a7fc640 10 monclient: dump: 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:50.630 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:50.631 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.628+0000 7f048bfff640 4 set_mon_vals no callback set 2024-04-15T14:59:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.628+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f047c01a210 con 0x7f048c0b57d0 2024-04-15T14:59:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.629+0000 7f04915c1640 10 monclient: get_auth_request con 0x7f047806ef20 auth_method 0 2024-04-15T14:59:50.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.629+0000 7f048a7fc640 10 client.4279.objecter ms_handle_connect 0x7f047806ef20 2024-04-15T14:59:50.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.631+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 3737+0+0 (unknown 1860972177 0 0) 0x7f047c052420 con 0x7f048c0b57d0 2024-04-15T14:59:50.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.631+0000 7f048a7fc640 10 client.4279.objecter ms_dispatch 0x7f048c000b90 osd_map(25..25 src has 1..25) 2024-04-15T14:59:50.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.631+0000 7f048a7fc640 3 client.4279.objecter handle_osd_map got epochs [25,25] > 0 2024-04-15T14:59:50.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.631+0000 7f048a7fc640 3 client.4279.objecter handle_osd_map decoding full epoch 25 2024-04-15T14:59:50.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.631+0000 7f048a7fc640 20 client.4279.objecter dump_active .. 0 homeless 2024-04-15T14:59:50.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.870+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f047c054820 con 0x7f048c0b57d0 2024-04-15T14:59:50.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.870+0000 7f048a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:50.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:50.870+0000 7f048a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.055+0000 7f0494026640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-04-15T14:59:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.055+0000 7f0494026640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-04-15T14:59:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.055+0000 7f0494026640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:51.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.055+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f048c13fe90 con 0x7f048c0b57d0 2024-04-15T14:59:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.569+0000 7f048a7fc640 1 -- 172.21.15.38:0/229708517 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v26) ==== 109+0+0 (unknown 437888687 0 0) 0x7f047c054120 con 0x7f048c0b57d0 2024-04-15T14:59:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.569+0000 7f048a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-04-15T14:59:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.569+0000 7f048a7fc640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-04-15T14:59:51.572 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'rbd' created 2024-04-15T14:59:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 10 librados: watch_flush enter 2024-04-15T14:59:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 10 librados: watch_flush exit 2024-04-15T14:59:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 20 client.4279.objecter shutdown clearing up homeless session... 2024-04-15T14:59:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 10 client.4279.objecter successfully canceled tick 2024-04-15T14:59:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 >> v1:172.21.15.38:6800/1608957829 conn(0x7f047806ef20 legacy=0x7f04780713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 10 monclient: shutdown 2024-04-15T14:59:51.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:51.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 >> v1:172.21.15.164:6789/0 conn(0x7f048c0b57d0 legacy=0x7f048c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:51.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 shutdown_connections 2024-04-15T14:59:51.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 >> 172.21.15.38:0/229708517 conn(0x7f048c067790 msgr2=0x7f048c067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:51.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 shutdown_connections 2024-04-15T14:59:51.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.572+0000 7f0494026640 1 -- 172.21.15.38:0/229708517 wait complete. 2024-04-15T14:59:51.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.573+0000 7f0494026640 1 librados: shutdown 2024-04-15T14:59:51.586 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.691+0000 7fcd1cc88640 10 monclient: get_monmap_and_config 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.691+0000 7fcd1cc88640 10 monclient: build_initial_monmap 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.691+0000 7fcd1cc88640 10 monclient: monmap: 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:51.692946+0000 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:51.692946+0000 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:51.693 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:51.694 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:51.694 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.691+0000 7fcd1cc88640 1 Processor -- start 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.691+0000 7fcd1cc88640 1 -- start start 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 10 monclient: init 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 10 monclient(hunting): picked mon.noname-c con 0x7fcd180b5a20 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 10 monclient(hunting): picked mon.noname-a con 0x7fcd1813cd80 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 10 monclient(hunting): picked mon.noname-b con 0x7fcd1813d200 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd1813d610 con 0x7fcd1813cd80 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180ac1c0 con 0x7fcd180b5a20 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180b5180 con 0x7fcd1813d200 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:51.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.692+0000 7fcd1cc88640 10 monclient(hunting): authenticate will time out at 1451.964011s 2024-04-15T14:59:51.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.693+0000 7fcd16d9d640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fcd1813d200 0x7fcd1814ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56662/0 (socket says 172.21.15.38:56662) 2024-04-15T14:59:51.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.693+0000 7fcd16d9d640 1 -- 172.21.15.38:0/3949825090 learned_addr learned my addr 172.21.15.38:0/3949825090 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:51.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.695+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 447174738 0 0) 0x7fcd180b5180 con 0x7fcd1813d200 2024-04-15T14:59:51.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.695+0000 7fcd15d9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:51.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.695+0000 7fcd15d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:51.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.695+0000 7fcd15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:51.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.695+0000 7fcd15d9b640 10 monclient(hunting): my global_id is 54194 2024-04-15T14:59:51.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.695+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd04003520 con 0x7fcd1813d200 2024-04-15T14:59:51.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560366492 0 0) 0x7fcd180ac1c0 con 0x7fcd180b5a20 2024-04-15T14:59:51.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:51.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:51.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:51.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 10 monclient(hunting): my global_id is 4282 2024-04-15T14:59:51.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd180b5180 con 0x7fcd180b5a20 2024-04-15T14:59:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85761141 0 0) 0x7fcd1813d610 con 0x7fcd1813cd80 2024-04-15T14:59:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 10 monclient(hunting): my global_id is 4293 2024-04-15T14:59:51.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.696+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd180ac1c0 con 0x7fcd1813cd80 2024-04-15T14:59:51.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1275980908 0 0) 0x7fcd04003520 con 0x7fcd1813d200 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 >> v1:172.21.15.164:6789/0 conn(0x7fcd180b5a20 legacy=0x7fcd180aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 >> v1:172.21.15.38:6789/0 conn(0x7fcd1813cd80 legacy=0x7fcd18143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 10 monclient: _finish_hunting 0 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 1 monclient: found mon.noname-b 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd18143ca0 con 0x7fcd1813d200 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 10 monclient: _finish_auth 0 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 10 monclient: _check_auth_tickets 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcd10001990 con 0x7fcd1813d200 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:51.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd15d9b640 10 monclient: dump: 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd1cc88640 5 monclient: authenticate success, global_id 54194 2024-04-15T14:59:51.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.698+0000 7fcd1cc88640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.700+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd10001bf0 con 0x7fcd1813d200 2024-04-15T14:59:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.700+0000 7fcd15d9b640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.700+0000 7fcd15d9b640 1 -- 172.21.15.38:0/3949825090 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcd10001fc0 con 0x7fcd1813d200 2024-04-15T14:59:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.700+0000 7fcd15d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.700+0000 7fcd15d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.700+0000 7fcd15d9b640 10 monclient: dump: 2024-04-15T14:59:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:51.704 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.700+0000 7fcd1cc88640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.700+0000 7fcd1cc88640 4 set_mon_vals no callback set 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.701+0000 7fcd1cc88640 10 monclient: shutdown 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.701+0000 7fcd1cc88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.701+0000 7fcd1cc88640 1 -- 172.21.15.38:0/3949825090 >> v1:172.21.15.38:6790/0 conn(0x7fcd1813d200 legacy=0x7fcd1814ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.701+0000 7fcd1cc88640 1 -- 172.21.15.38:0/3949825090 shutdown_connections 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.701+0000 7fcd1cc88640 1 -- 172.21.15.38:0/3949825090 >> 172.21.15.38:0/3949825090 conn(0x7fcd18067790 msgr2=0x7fcd18067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:51.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.701+0000 7fcd1cc88640 1 -- 172.21.15.38:0/3949825090 shutdown_connections 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.701+0000 7fcd1cc88640 1 -- 172.21.15.38:0/3949825090 wait complete. 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.702+0000 7fcd1cc88640 10 monclient: build_initial_monmap 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.702+0000 7fcd1cc88640 10 monclient: monmap: 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:51.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.702+0000 7fcd1cc88640 1 librados: starting msgr at 2024-04-15T14:59:51.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.702+0000 7fcd1cc88640 1 librados: starting objecter 2024-04-15T14:59:51.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.702+0000 7fcd1cc88640 1 Processor -- start 2024-04-15T14:59:51.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.702+0000 7fcd1cc88640 1 -- start start 2024-04-15T14:59:51.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.702+0000 7fcd1cc88640 1 librados: setting wanted keys 2024-04-15T14:59:51.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.702+0000 7fcd1cc88640 1 librados: calling monclient init 2024-04-15T14:59:51.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.702+0000 7fcd1cc88640 10 monclient: init 2024-04-15T14:59:51.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:51.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:51.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 10 monclient(hunting): picked mon.noname-c con 0x7fcd180b5a20 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:51.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 10 monclient(hunting): picked mon.noname-a con 0x7fcd1813cd80 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:51.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 10 monclient(hunting): picked mon.noname-b con 0x7fcd1813d200 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180ad1d0 con 0x7fcd1813cd80 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180ad4b0 con 0x7fcd1813d200 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd181d59f0 con 0x7fcd180b5a20 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1cc88640 10 monclient(hunting): authenticate will time out at 1451.974690s 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1659c640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fcd180b5a20 0x7fcd180b0fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56670/0 (socket says 172.21.15.38:56670) 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.703+0000 7fcd1659c640 1 -- 172.21.15.38:0/208394379 learned_addr learned my addr 172.21.15.38:0/208394379 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.704+0000 7fcd0effd640 10 client.?.objecter ms_handle_connect 0x7fcd180b5a20 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.704+0000 7fcd0effd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.704+0000 7fcd0effd640 10 client.?.objecter ms_handle_connect 0x7fcd1813cd80 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.704+0000 7fcd0effd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.704+0000 7fcd0effd640 10 client.?.objecter ms_handle_connect 0x7fcd1813d200 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.704+0000 7fcd0effd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:51.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396658776 0 0) 0x7fcd180ad4b0 con 0x7fcd1813d200 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 10 monclient(hunting): my global_id is 4285 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccf8004eb0 con 0x7fcd1813d200 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496570339 0 0) 0x7fcd181d59f0 con 0x7fcd180b5a20 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 10 monclient(hunting): my global_id is 54197 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd180ad4b0 con 0x7fcd180b5a20 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.706+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967215407 0 0) 0x7fcd180ad1d0 con 0x7fcd1813cd80 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.707+0000 7fcd0effd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.707+0000 7fcd0effd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:51.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.707+0000 7fcd0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:51.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.707+0000 7fcd0effd640 10 monclient(hunting): my global_id is 4296 2024-04-15T14:59:51.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.707+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd181d59f0 con 0x7fcd1813cd80 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3996601639 0 0) 0x7fccf8004eb0 con 0x7fcd1813d200 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd180ad1d0 con 0x7fcd1813d200 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcd10001f40 con 0x7fcd1813d200 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 10 monclient(hunting): dump: 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.713 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2240237490 0 0) 0x7fcd180ad4b0 con 0x7fcd180b5a20 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fccf8004eb0 con 0x7fcd180b5a20 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcd080019b0 con 0x7fcd180b5a20 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.711+0000 7fcd0effd640 10 monclient(hunting): dump: 2024-04-15T14:59:51.714 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:51.715 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:51.715 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.715 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.715 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:51.715 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:51.715 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:51.715 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:51.715 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:51.715 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:51.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1829404990 0 0) 0x7fcd181d59f0 con 0x7fcd1813cd80 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd180ad4b0 con 0x7fcd1813cd80 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcd000018b0 con 0x7fcd1813cd80 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 10 monclient(hunting): dump: 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:51.717 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3207311930 0 0) 0x7fccf8004eb0 con 0x7fcd180b5a20 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 >> v1:172.21.15.164:6789/0 conn(0x7fcd1813d200 legacy=0x7fcd181e3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 >> v1:172.21.15.38:6789/0 conn(0x7fcd1813cd80 legacy=0x7fcd181db7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 1 monclient: found mon.c 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd180b1c20 con 0x7fcd180b5a20 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 10 monclient: _finish_auth 0 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd1cc88640 5 monclient: authenticate success, global_id 54197 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd1cc88640 10 monclient: _renew_subs 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd1cc88640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:51.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.713+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcd180b1eb0 con 0x7fcd180b5a20 2024-04-15T14:59:51.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.714+0000 7fcd1cc88640 10 client.54197.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:51.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.714+0000 7fcd1cc88640 10 monclient: _renew_subs 2024-04-15T14:59:51.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.714+0000 7fcd1cc88640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:51.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.714+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcd180b1890 con 0x7fcd180b5a20 2024-04-15T14:59:51.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.714+0000 7fcd1cc88640 1 librados: init done 2024-04-15T14:59:51.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.714+0000 7fcd1cc88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:51.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.714+0000 7fcd1cc88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:51.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.714+0000 7fcd1cc88640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:51.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:51.714+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd18077050 con 0x7fcd180b5a20 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.027+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd08001c70 con 0x7fcd180b5a20 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.027+0000 7fcd0effd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.027+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcd08003a60 con 0x7fcd180b5a20 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.027+0000 7fcd0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.027+0000 7fcd0effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.027+0000 7fcd0effd640 10 monclient: dump: 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:52.031 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.027+0000 7fcd1559a640 4 set_mon_vals no callback set 2024-04-15T14:59:52.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.028+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fcd08003c00 con 0x7fcd180b5a20 2024-04-15T14:59:52.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.029+0000 7fcd0ffff640 10 monclient: get_auth_request con 0x7fccf806efa0 auth_method 0 2024-04-15T14:59:52.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.029+0000 7fcd0effd640 10 client.54197.objecter ms_handle_connect 0x7fccf806efa0 2024-04-15T14:59:52.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.037+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(26..26 src has 1..26) ==== 4079+0+0 (unknown 2740359391 0 0) 0x7fcd08053350 con 0x7fcd180b5a20 2024-04-15T14:59:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.037+0000 7fcd0effd640 10 client.54197.objecter ms_dispatch 0x7fcd18000b90 osd_map(26..26 src has 1..26) 2024-04-15T14:59:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.037+0000 7fcd0effd640 3 client.54197.objecter handle_osd_map got epochs [26,26] > 0 2024-04-15T14:59:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.037+0000 7fcd0effd640 3 client.54197.objecter handle_osd_map decoding full epoch 26 2024-04-15T14:59:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.037+0000 7fcd0effd640 20 client.54197.objecter dump_active .. 0 homeless 2024-04-15T14:59:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.037+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fcd08055750 con 0x7fcd180b5a20 2024-04-15T14:59:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.037+0000 7fcd0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:52.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.037+0000 7fcd0effd640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.236+0000 7fcd1cc88640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-04-15T14:59:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.237+0000 7fcd1cc88640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-04-15T14:59:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.237+0000 7fcd1cc88640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:52.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.237+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7fcd18075fe0 con 0x7fcd180b5a20 2024-04-15T14:59:52.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.688+0000 7fcd0effd640 1 -- 172.21.15.38:0/208394379 <== mon.2 v1:172.21.15.38:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v27) ==== 173+0+0 (unknown 2475129220 0 0) 0x7fcd08055050 con 0x7fcd180b5a20 2024-04-15T14:59:52.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.688+0000 7fcd0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-04-15T14:59:52.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.688+0000 7fcd0effd640 10 monclient: _finish_command 2 = system:0 enabled application 'rbd' on pool 'rbd' 2024-04-15T14:59:52.691 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-15T14:59:52.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.690+0000 7fcd1cc88640 10 librados: watch_flush enter 2024-04-15T14:59:52.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 10 librados: watch_flush exit 2024-04-15T14:59:52.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 20 client.54197.objecter shutdown clearing up homeless session... 2024-04-15T14:59:52.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 10 client.54197.objecter successfully canceled tick 2024-04-15T14:59:52.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 >> v1:172.21.15.38:6800/1608957829 conn(0x7fccf806efa0 legacy=0x7fccf8071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 10 monclient: shutdown 2024-04-15T14:59:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 >> v1:172.21.15.38:6790/0 conn(0x7fcd180b5a20 legacy=0x7fcd180b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 shutdown_connections 2024-04-15T14:59:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 >> 172.21.15.38:0/208394379 conn(0x7fcd18067790 msgr2=0x7fcd18067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 shutdown_connections 2024-04-15T14:59:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 1 -- 172.21.15.38:0/208394379 wait complete. 2024-04-15T14:59:52.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.691+0000 7fcd1cc88640 1 librados: shutdown 2024-04-15T14:59:52.703 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-15T14:59:52.704 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-15T14:59:52.704 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-15T14:59:52.704 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-15T14:59:52.705 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-15T14:59:52.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.809+0000 7ffa27311640 10 monclient: get_monmap_and_config 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.809+0000 7ffa27311640 10 monclient: build_initial_monmap 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.809+0000 7ffa27311640 10 monclient: monmap: 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:52.811694+0000 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:52.811694+0000 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:52.812 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.810+0000 7ffa27311640 1 Processor -- start 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.810+0000 7ffa27311640 1 -- start start 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.810+0000 7ffa27311640 10 monclient: init 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 10 monclient(hunting): picked mon.noname-a con 0x7ffa200b57b0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 10 monclient(hunting): picked mon.noname-c con 0x7ffa200b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 10 monclient(hunting): picked mon.noname-b con 0x7ffa20146d70 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa20140ca0 con 0x7ffa200b57b0 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa200ab0e0 con 0x7ffa200b5b90 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa200b3310 con 0x7ffa20146d70 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:52.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa27311640 10 monclient(hunting): authenticate will time out at 1453.082913s 2024-04-15T14:59:52.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa258ae640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7ffa20146d70 0x7ffa2014ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45628/0 (socket says 172.21.15.38:45628) 2024-04-15T14:59:52.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.811+0000 7ffa258ae640 1 -- 172.21.15.38:0/3536017712 learned_addr learned my addr 172.21.15.38:0/3536017712 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:52.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019082409 0 0) 0x7ffa200b3310 con 0x7ffa20146d70 2024-04-15T14:59:52.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:52.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:52.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:52.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): my global_id is 54200 2024-04-15T14:59:52.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa0c003520 con 0x7ffa20146d70 2024-04-15T14:59:52.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282047414 0 0) 0x7ffa200ab0e0 con 0x7ffa200b5b90 2024-04-15T14:59:52.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:52.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:52.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:52.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): my global_id is 4288 2024-04-15T14:59:52.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa200b3310 con 0x7ffa200b5b90 2024-04-15T14:59:52.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566025017 0 0) 0x7ffa20140ca0 con 0x7ffa200b57b0 2024-04-15T14:59:52.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:52.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:52.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:52.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 10 monclient(hunting): my global_id is 4299 2024-04-15T14:59:52.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.815+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa200ab0e0 con 0x7ffa200b57b0 2024-04-15T14:59:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1850382968 0 0) 0x7ffa0c003520 con 0x7ffa20146d70 2024-04-15T14:59:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 >> v1:172.21.15.164:6789/0 conn(0x7ffa200b5b90 legacy=0x7ffa20146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 >> v1:172.21.15.38:6789/0 conn(0x7ffa200b57b0 legacy=0x7ffa20140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 1 monclient: found mon.noname-b 2024-04-15T14:59:52.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa200aa460 con 0x7ffa20146d70 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 10 monclient: _finish_auth 0 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ffa18001990 con 0x7ffa20146d70 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa13fff640 10 monclient: dump: 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:52.822 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa27311640 5 monclient: authenticate success, global_id 54200 2024-04-15T14:59:52.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.819+0000 7ffa27311640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.824+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa18001bf0 con 0x7ffa20146d70 2024-04-15T14:59:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.824+0000 7ffa13fff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.824+0000 7ffa13fff640 1 -- 172.21.15.38:0/3536017712 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ffa18001fc0 con 0x7ffa20146d70 2024-04-15T14:59:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.824+0000 7ffa13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:52.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.824+0000 7ffa13fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.824+0000 7ffa13fff640 10 monclient: dump: 2024-04-15T14:59:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:52.827 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:52.828 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:52.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.824+0000 7ffa27311640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:52.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.824+0000 7ffa27311640 4 set_mon_vals no callback set 2024-04-15T14:59:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.825+0000 7ffa27311640 10 monclient: shutdown 2024-04-15T14:59:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.825+0000 7ffa27311640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.825+0000 7ffa27311640 1 -- 172.21.15.38:0/3536017712 >> v1:172.21.15.38:6790/0 conn(0x7ffa20146d70 legacy=0x7ffa2014ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.825+0000 7ffa27311640 1 -- 172.21.15.38:0/3536017712 shutdown_connections 2024-04-15T14:59:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.825+0000 7ffa27311640 1 -- 172.21.15.38:0/3536017712 >> 172.21.15.38:0/3536017712 conn(0x7ffa20067790 msgr2=0x7ffa20067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.825+0000 7ffa27311640 1 -- 172.21.15.38:0/3536017712 shutdown_connections 2024-04-15T14:59:52.832 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.825+0000 7ffa27311640 1 -- 172.21.15.38:0/3536017712 wait complete. 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.826+0000 7ffa27311640 10 monclient: build_initial_monmap 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.826+0000 7ffa27311640 10 monclient: monmap: 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 1 librados: starting msgr at 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 1 librados: starting objecter 2024-04-15T14:59:52.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 1 Processor -- start 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 1 -- start start 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 1 librados: setting wanted keys 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 1 librados: calling monclient init 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 10 monclient: init 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 10 monclient(hunting): picked mon.noname-c con 0x7ffa200b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 10 monclient(hunting): picked mon.noname-b con 0x7ffa200b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 10 monclient(hunting): picked mon.noname-a con 0x7ffa20146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa20137ab0 con 0x7ffa20146d70 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa201d92d0 con 0x7ffa200b5b90 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa20141300 con 0x7ffa200b57b0 2024-04-15T14:59:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.827+0000 7ffa27311640 10 monclient(hunting): authenticate will time out at 1453.099300s 2024-04-15T14:59:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.828+0000 7ffa250ad640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7ffa200b57b0 0x7ffa20135ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45634/0 (socket says 172.21.15.38:45634) 2024-04-15T14:59:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.828+0000 7ffa250ad640 1 -- 172.21.15.38:0/2735608457 learned_addr learned my addr 172.21.15.38:0/2735608457 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.828+0000 7ffa11ffb640 10 client.?.objecter ms_handle_connect 0x7ffa200b57b0 2024-04-15T14:59:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.828+0000 7ffa11ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.828+0000 7ffa11ffb640 10 client.?.objecter ms_handle_connect 0x7ffa200b5b90 2024-04-15T14:59:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.828+0000 7ffa11ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.828+0000 7ffa11ffb640 10 client.?.objecter ms_handle_connect 0x7ffa20146d70 2024-04-15T14:59:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.828+0000 7ffa11ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.830+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033137183 0 0) 0x7ffa20141300 con 0x7ffa200b57b0 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): my global_id is 54203 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa04004eb0 con 0x7ffa200b57b0 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574973374 0 0) 0x7ffa201d92d0 con 0x7ffa200b5b90 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): my global_id is 4291 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa20141300 con 0x7ffa200b5b90 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258448355 0 0) 0x7ffa20137ab0 con 0x7ffa20146d70 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:52.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:52.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 10 monclient(hunting): my global_id is 4302 2024-04-15T14:59:52.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.831+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa201d92d0 con 0x7ffa20146d70 2024-04-15T14:59:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.836+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2054037863 0 0) 0x7ffa20141300 con 0x7ffa200b5b90 2024-04-15T14:59:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.836+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa20137ab0 con 0x7ffa200b5b90 2024-04-15T14:59:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.836+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ffa140018b0 con 0x7ffa200b5b90 2024-04-15T14:59:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.836+0000 7ffa11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:52.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.836+0000 7ffa11ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.836+0000 7ffa11ffb640 10 monclient(hunting): dump: 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:52.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.836+0000 7ffa11ffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4260363588 0 0) 0x7ffa04004eb0 con 0x7ffa200b57b0 2024-04-15T14:59:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa20141300 con 0x7ffa200b57b0 2024-04-15T14:59:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ffa1c001990 con 0x7ffa200b57b0 2024-04-15T14:59:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 10 monclient(hunting): dump: 2024-04-15T14:59:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:52.843 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2236834234 0 0) 0x7ffa201d92d0 con 0x7ffa20146d70 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa04004eb0 con 0x7ffa20146d70 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ffa18001da0 con 0x7ffa20146d70 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.838+0000 7ffa11ffb640 10 monclient(hunting): dump: 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:52.844 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 748585262 0 0) 0x7ffa20137ab0 con 0x7ffa200b5b90 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 >> v1:172.21.15.38:6790/0 conn(0x7ffa200b57b0 legacy=0x7ffa20135ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 >> v1:172.21.15.38:6789/0 conn(0x7ffa20146d70 legacy=0x7ffa201e2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 10 monclient: _finish_hunting 0 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 1 monclient: found mon.b 2024-04-15T14:59:52.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa201414d0 con 0x7ffa200b5b90 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 10 monclient: _finish_auth 0 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 10 monclient: _check_auth_tickets 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa27311640 5 monclient: authenticate success, global_id 4291 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa27311640 10 monclient: _renew_subs 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa27311640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffa20143c20 con 0x7ffa200b5b90 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa27311640 10 client.4291.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa27311640 10 monclient: _renew_subs 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa27311640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffa201e4620 con 0x7ffa200b5b90 2024-04-15T14:59:52.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.840+0000 7ffa27311640 1 librados: init done 2024-04-15T14:59:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.842+0000 7ffa27311640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.842+0000 7ffa27311640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.842+0000 7ffa27311640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:52.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:52.842+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa20077050 con 0x7ffa200b5b90 2024-04-15T14:59:53.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.187+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa140035f0 con 0x7ffa200b5b90 2024-04-15T14:59:53.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.187+0000 7ffa11ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:53.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.187+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ffa14003940 con 0x7ffa200b5b90 2024-04-15T14:59:53.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.187+0000 7ffa11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.187+0000 7ffa11ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.187+0000 7ffa11ffb640 10 monclient: dump: 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:53.190 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:53.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.187+0000 7ffa137fe640 4 set_mon_vals no callback set 2024-04-15T14:59:53.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.188+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7ffa14019e70 con 0x7ffa200b5b90 2024-04-15T14:59:53.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.189+0000 7ffa250ad640 10 monclient: get_auth_request con 0x7ffa0406efd0 auth_method 0 2024-04-15T14:59:53.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.189+0000 7ffa11ffb640 10 client.4291.objecter ms_handle_connect 0x7ffa0406efd0 2024-04-15T14:59:53.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.191+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(27..27 src has 1..27) ==== 4090+0+0 (unknown 1769973587 0 0) 0x7ffa14052090 con 0x7ffa200b5b90 2024-04-15T14:59:53.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.191+0000 7ffa11ffb640 10 client.4291.objecter ms_dispatch 0x7ffa20000b90 osd_map(27..27 src has 1..27) 2024-04-15T14:59:53.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.191+0000 7ffa11ffb640 3 client.4291.objecter handle_osd_map got epochs [27,27] > 0 2024-04-15T14:59:53.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.191+0000 7ffa11ffb640 3 client.4291.objecter handle_osd_map decoding full epoch 27 2024-04-15T14:59:53.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.191+0000 7ffa11ffb640 20 client.4291.objecter dump_active .. 0 homeless 2024-04-15T14:59:53.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.194+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7ffa14054490 con 0x7ffa200b5b90 2024-04-15T14:59:53.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.194+0000 7ffa11ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:53.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.194+0000 7ffa11ffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.453+0000 7ffa27311640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-04-15T14:59:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.453+0000 7ffa27311640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-04-15T14:59:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.453+0000 7ffa27311640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:53.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.453+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ffa201d8450 con 0x7ffa200b5b90 2024-04-15T14:59:53.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.588+0000 7ffa11ffb640 1 -- 172.21.15.38:0/2735608457 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174077 (unknown 481731318 0 350186569) 0x7ffa14053d90 con 0x7ffa200b5b90 2024-04-15T14:59:53.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.588+0000 7ffa11ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-04-15T14:59:53.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.588+0000 7ffa11ffb640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:53.593 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 10 librados: watch_flush enter 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 10 librados: watch_flush exit 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 20 client.4291.objecter shutdown clearing up homeless session... 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 10 client.4291.objecter successfully canceled tick 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 >> v1:172.21.15.38:6800/1608957829 conn(0x7ffa0406efd0 legacy=0x7ffa04071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 10 monclient: shutdown 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 >> v1:172.21.15.164:6789/0 conn(0x7ffa200b5b90 legacy=0x7ffa201d8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 shutdown_connections 2024-04-15T14:59:53.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 >> 172.21.15.38:0/2735608457 conn(0x7ffa20067790 msgr2=0x7ffa200b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:53.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 shutdown_connections 2024-04-15T14:59:53.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 1 -- 172.21.15.38:0/2735608457 wait complete. 2024-04-15T14:59:53.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.590+0000 7ffa27311640 1 librados: shutdown 2024-04-15T14:59:53.603 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6800","nonce":1608957829}]},"active_addr":"172.21.15.38:6800/1608957829","active_change":"2024-04-15T14:58:54.187690+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":1014333004}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":1162511122}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":1532439639}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":1974908016}]}]} 2024-04-15T14:59:53.607 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-15T14:59:53.608 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-15T14:59:53.608 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T14:59:53.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.716+0000 7f896486e640 10 monclient: get_monmap_and_config 2024-04-15T14:59:53.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.716+0000 7f896486e640 10 monclient: build_initial_monmap 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.716+0000 7f896486e640 10 monclient: monmap: 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:53.718354+0000 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:53.718354+0000 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:53.719 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.717+0000 7f896486e640 1 Processor -- start 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.717+0000 7f896486e640 1 -- start start 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.717+0000 7f896486e640 10 monclient: init 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 10 monclient(hunting): picked mon.noname-b con 0x7f89600b56f0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 10 monclient(hunting): picked mon.noname-a con 0x7f8960140480 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 10 monclient(hunting): picked mon.noname-c con 0x7f8960146dd0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89600ac230 con 0x7f8960140480 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89600aac50 con 0x7f8960146dd0 2024-04-15T14:59:53.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89600ab170 con 0x7f89600b56f0 2024-04-15T14:59:53.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:53.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.718+0000 7f896486e640 10 monclient(hunting): authenticate will time out at 1453.989803s 2024-04-15T14:59:53.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.721+0000 7f8957fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8960140480 0x7f89601466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55574/0 (socket says 172.21.15.38:55574) 2024-04-15T14:59:53.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.721+0000 7f8957fff640 1 -- 172.21.15.38:0/795095591 learned_addr learned my addr 172.21.15.38:0/795095591 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:53.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.775+0000 7f895dd9b640 1 -- 172.21.15.38:0/795095591 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406386832 0 0) 0x7f89600aac50 con 0x7f8960146dd0 2024-04-15T14:59:53.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.775+0000 7f895dd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:53.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.775+0000 7f895dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:53.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.775+0000 7f895dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:53.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.775+0000 7f895dd9b640 10 monclient(hunting): my global_id is 4294 2024-04-15T14:59:53.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.775+0000 7f895dd9b640 1 -- 172.21.15.38:0/795095591 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f894c003520 con 0x7f8960146dd0 2024-04-15T14:59:53.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 1 -- 172.21.15.38:0/795095591 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3475855359 0 0) 0x7f894c003520 con 0x7f8960146dd0 2024-04-15T14:59:53.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 1 -- 172.21.15.38:0/795095591 >> v1:172.21.15.38:6790/0 conn(0x7f89600b56f0 legacy=0x7f89600aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:53.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 1 -- 172.21.15.38:0/795095591 >> v1:172.21.15.38:6789/0 conn(0x7f8960140480 legacy=0x7f89601466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:53.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 10 monclient: _finish_hunting 0 2024-04-15T14:59:53.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 1 monclient: found mon.noname-c 2024-04-15T14:59:53.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:53.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 1 -- 172.21.15.38:0/795095591 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89600b5ad0 con 0x7f8960146dd0 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 10 monclient: _finish_auth 0 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 10 monclient: _check_auth_tickets 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 1 -- 172.21.15.38:0/795095591 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8958001990 con 0x7f8960146dd0 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f895dd9b640 10 monclient: dump: 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:53.782 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f896486e640 5 monclient: authenticate success, global_id 4294 2024-04-15T14:59:53.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.779+0000 7f896486e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f895dd9b640 1 -- 172.21.15.38:0/795095591 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8958001bf0 con 0x7f8960146dd0 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f895dd9b640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f895dd9b640 1 -- 172.21.15.38:0/795095591 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8958001fc0 con 0x7f8960146dd0 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f896486e640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f896486e640 4 set_mon_vals no callback set 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f895dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f895dd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f895dd9b640 10 monclient: dump: 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.787 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f896486e640 10 monclient: shutdown 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f896486e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f896486e640 1 -- 172.21.15.38:0/795095591 >> v1:172.21.15.164:6789/0 conn(0x7f8960146dd0 legacy=0x7f896014ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f896486e640 1 -- 172.21.15.38:0/795095591 shutdown_connections 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f896486e640 1 -- 172.21.15.38:0/795095591 >> 172.21.15.38:0/795095591 conn(0x7f8960067790 msgr2=0x7f8960067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f896486e640 1 -- 172.21.15.38:0/795095591 shutdown_connections 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.781+0000 7f896486e640 1 -- 172.21.15.38:0/795095591 wait complete. 2024-04-15T14:59:53.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.782+0000 7f896486e640 10 monclient: build_initial_monmap 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.782+0000 7f896486e640 10 monclient: monmap: 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:53.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.782+0000 7f896486e640 1 librados: starting msgr at 2024-04-15T14:59:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.782+0000 7f896486e640 1 librados: starting objecter 2024-04-15T14:59:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 1 Processor -- start 2024-04-15T14:59:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 1 -- start start 2024-04-15T14:59:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 1 librados: setting wanted keys 2024-04-15T14:59:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 1 librados: calling monclient init 2024-04-15T14:59:53.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 10 monclient: init 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 10 monclient(hunting): picked mon.noname-b con 0x7f89600b56f0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 10 monclient(hunting): picked mon.noname-c con 0x7f8960140480 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 10 monclient(hunting): picked mon.noname-a con 0x7f8960146dd0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8960141670 con 0x7f8960146dd0 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89601db920 con 0x7f89600b56f0 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89601dc510 con 0x7f8960140480 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.783+0000 7f896486e640 10 monclient(hunting): authenticate will time out at 1454.055195s 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.784+0000 7f8957fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f8960140480 0x7f89601dbe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45658/0 (socket says 172.21.15.38:45658) 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.784+0000 7f8957fff640 1 -- 172.21.15.38:0/1411652983 learned_addr learned my addr 172.21.15.38:0/1411652983 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.784+0000 7f8956ffd640 10 client.?.objecter ms_handle_connect 0x7f8960140480 2024-04-15T14:59:53.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.784+0000 7f8956ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.784+0000 7f8956ffd640 10 client.?.objecter ms_handle_connect 0x7f89600b56f0 2024-04-15T14:59:53.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.784+0000 7f8956ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:53.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839914018 0 0) 0x7f89601dc510 con 0x7f8960140480 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 10 monclient(hunting): my global_id is 54209 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8940004eb0 con 0x7f8960140480 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306716674 0 0) 0x7f89601db920 con 0x7f89600b56f0 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 10 monclient(hunting): my global_id is 4297 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.786+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89601dc510 con 0x7f89600b56f0 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.787+0000 7f8956ffd640 10 client.?.objecter ms_handle_connect 0x7f8960146dd0 2024-04-15T14:59:53.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.787+0000 7f8956ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.789+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500947606 0 0) 0x7f89600b5ad0 con 0x7f8960146dd0 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.789+0000 7f8956ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.789+0000 7f8956ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.789+0000 7f8956ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.789+0000 7f8956ffd640 10 monclient(hunting): my global_id is 4308 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.789+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89601db920 con 0x7f8960146dd0 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.790+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 452711253 0 0) 0x7f89601dc510 con 0x7f89600b56f0 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.790+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89600b5ad0 con 0x7f89600b56f0 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.790+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8950001870 con 0x7f89600b56f0 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.790+0000 7f8956ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.790+0000 7f8956ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.790+0000 7f8956ffd640 10 monclient(hunting): dump: 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:53.795 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.790+0000 7f8956ffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.791+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 344862037 0 0) 0x7f8940004eb0 con 0x7f8960140480 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.791+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89601dc510 con 0x7f8960140480 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.791+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f89480017a0 con 0x7f8960140480 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.791+0000 7f8956ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.791+0000 7f8956ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:53.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.791+0000 7f8956ffd640 10 monclient(hunting): dump: 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:53.797 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 796587465 0 0) 0x7f89600b5ad0 con 0x7f89600b56f0 2024-04-15T14:59:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 >> v1:172.21.15.38:6790/0 conn(0x7f8960140480 legacy=0x7f89601dbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 >> v1:172.21.15.38:6789/0 conn(0x7f8960146dd0 legacy=0x7f8960134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:53.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 1 monclient: found mon.b 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8960142590 con 0x7f89600b56f0 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f8956ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f896486e640 5 monclient: authenticate success, global_id 4297 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f896486e640 10 monclient: _renew_subs 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f896486e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8960138060 con 0x7f89600b56f0 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f896486e640 10 client.4297.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f896486e640 10 monclient: _renew_subs 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f896486e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:53.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8960135700 con 0x7f89600b56f0 2024-04-15T14:59:53.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.794+0000 7f896486e640 1 librados: init done 2024-04-15T14:59:53.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.795+0000 7f896486e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:53.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.795+0000 7f896486e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:53.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.795+0000 7f896486e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:53.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.795+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8960077050 con 0x7f89600b56f0 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.809+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8950003610 con 0x7f89600b56f0 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.809+0000 7f8956ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.809+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8950003960 con 0x7f89600b56f0 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.809+0000 7f8956ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.809+0000 7f8956ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.809+0000 7f895cd99640 4 set_mon_vals no callback set 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.809+0000 7f8956ffd640 10 monclient: dump: 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:53.811 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.812 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:53.812 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:53.812 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:53.812 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:53.812 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:53.812 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:53.812 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:53.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.809+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f8950003b00 con 0x7f89600b56f0 2024-04-15T14:59:53.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.810+0000 7f8957fff640 10 monclient: get_auth_request con 0x7f894006ee70 auth_method 0 2024-04-15T14:59:53.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.810+0000 7f8956ffd640 10 client.4297.objecter ms_handle_connect 0x7f894006ee70 2024-04-15T14:59:53.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.812+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f8950052290 con 0x7f89600b56f0 2024-04-15T14:59:53.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.812+0000 7f8956ffd640 10 client.4297.objecter ms_dispatch 0x7f8960000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:53.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.812+0000 7f8956ffd640 3 client.4297.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:53.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.812+0000 7f8956ffd640 3 client.4297.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:53.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:53.812+0000 7f8956ffd640 20 client.4297.objecter dump_active .. 0 homeless 2024-04-15T14:59:54.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.051+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f8950054690 con 0x7f89600b56f0 2024-04-15T14:59:54.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.051+0000 7f8956ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:54.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.051+0000 7f8956ffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.238+0000 7f896486e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.238+0000 7f896486e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.238+0000 7f896486e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:54.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.238+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8960138230 con 0x7f89600b56f0 2024-04-15T14:59:54.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.268+0000 7f8956ffd640 1 -- 172.21.15.38:0/1411652983 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+12797 (unknown 634195324 0 3835457196) 0x7f8950053f90 con 0x7f89600b56f0 2024-04-15T14:59:54.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.268+0000 7f8956ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:54.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.268+0000 7f8956ffd640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:54.271 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:59:54.271 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:59:53.572488+0000","last_up_change":"2024-04-15T14:59:46.146485+0000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T14:59:35.434715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T14:59:51.069858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6805","nonce":3048929997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6807","nonce":3048929997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6810","nonce":3048929997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6808","nonce":3048929997}]},"public_addr":"172.21.15.38:6805/3048929997","cluster_addr":"172.21.15.38:6807/3048929997","heartbeat_back_addr":"172.21.15.38:6810/3048929997","heartbeat_front_addr":"172.21.15.38:6808/3048929997","state":["exists","up"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6806","nonce":3103013511}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6809","nonce":3103013511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6812","nonce":3103013511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6811","nonce":3103013511}]},"public_addr":"172.21.15.38:6806/3103013511","cluster_addr":"172.21.15.38:6809/3103013511","heartbeat_back_addr":"172.21.15.38:6812/3103013511","heartbeat_front_addr":"172.21.15.38:6811/3103013511","state":["exists","up"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6801","nonce":2505059545}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6802","nonce":2505059545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6804","nonce":2505059545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6803","nonce":2505059545}]},"public_addr":"172.21.15.38:6801/2505059545","cluster_addr":"172.21.15.38:6802/2505059545","heartbeat_back_addr":"172.21.15.38:6804/2505059545","heartbeat_front_addr":"172.21.15.38:6803/2505059545","state":["exists","up"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6813","nonce":2746933626}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6814","nonce":2746933626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6816","nonce":2746933626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6815","nonce":2746933626}]},"public_addr":"172.21.15.38:6813/2746933626","cluster_addr":"172.21.15.38:6814/2746933626","heartbeat_back_addr":"172.21.15.38:6816/2746933626","heartbeat_front_addr":"172.21.15.38:6815/2746933626","state":["exists","up"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6812","nonce":1135451953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6813","nonce":1135451953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6815","nonce":1135451953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6814","nonce":1135451953}]},"public_addr":"172.21.15.164:6812/1135451953","cluster_addr":"172.21.15.164:6813/1135451953","heartbeat_back_addr":"172.21.15.164:6815/1135451953","heartbeat_front_addr":"172.21.15.164:6814/1135451953","state":["exists","up"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6804","nonce":350713352}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6805","nonce":350713352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6807","nonce":350713352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6806","nonce":350713352}]},"public_addr":"172.21.15.164:6804/350713352","cluster_addr":"172.21.15.164:6805/350713352","heartbeat_back_addr":"172.21.15.164:6807/350713352","heartbeat_front_addr":"172.21.15.164:6806/350713352","state":["exists","up"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6808","nonce":3078148286}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6809","nonce":3078148286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6811","nonce":3078148286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6810","nonce":3078148286}]},"public_addr":"172.21.15.164:6808/3078148286","cluster_addr":"172.21.15.164:6809/3078148286","heartbeat_back_addr":"172.21.15.164:6811/3078148286","heartbeat_front_addr":"172.21.15.164:6810/3078148286","state":["exists","up"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6800","nonce":3353977755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6801","nonce":3353977755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6803","nonce":3353977755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6802","nonce":3353977755}]},"public_addr":"172.21.15.164:6800/3353977755","cluster_addr":"172.21.15.164:6801/3353977755","heartbeat_back_addr":"172.21.15.164:6803/3353977755","heartbeat_front_addr":"172.21.15.164:6802/3353977755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.779245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.754228+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.720273+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.101812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:30.038226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:30.010400+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.842035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.987364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:59:54.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 10 librados: watch_flush enter 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 10 librados: watch_flush exit 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 20 client.4297.objecter shutdown clearing up homeless session... 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 10 client.4297.objecter successfully canceled tick 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 >> v1:172.21.15.38:6800/1608957829 conn(0x7f894006ee70 legacy=0x7f8940071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 10 monclient: shutdown 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 >> v1:172.21.15.164:6789/0 conn(0x7f89600b56f0 legacy=0x7f8960140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 shutdown_connections 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 >> 172.21.15.38:0/1411652983 conn(0x7f8960067790 msgr2=0x7f896013fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 shutdown_connections 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 1 -- 172.21.15.38:0/1411652983 wait complete. 2024-04-15T14:59:54.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.270+0000 7f896486e640 1 librados: shutdown 2024-04-15T14:59:54.284 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-15T14:59:54.284 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T14:59:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.385+0000 7fcf6a693640 10 monclient: get_monmap_and_config 2024-04-15T14:59:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.385+0000 7fcf6a693640 10 monclient: build_initial_monmap 2024-04-15T14:59:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.385+0000 7fcf6a693640 10 monclient: monmap: 2024-04-15T14:59:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:54.387058+0000 2024-04-15T14:59:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:54.387058+0000 2024-04-15T14:59:54.387 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:54.388 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:54.388 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 1 Processor -- start 2024-04-15T14:59:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 1 -- start start 2024-04-15T14:59:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 10 monclient: init 2024-04-15T14:59:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 10 monclient(hunting): picked mon.noname-b con 0x7fcf64072bf0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 10 monclient(hunting): picked mon.noname-a con 0x7fcf6413e850 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:54.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 10 monclient(hunting): picked mon.noname-c con 0x7fcf64144c10 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640b1dd0 con 0x7fcf6413e850 2024-04-15T14:59:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640b0b00 con 0x7fcf64144c10 2024-04-15T14:59:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf64073620 con 0x7fcf64072bf0 2024-04-15T14:59:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.386+0000 7fcf6a693640 10 monclient(hunting): authenticate will time out at 1454.658370s 2024-04-15T14:59:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.387+0000 7fcf63fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fcf64072bf0 0x7fcf6413e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45672/0 (socket says 172.21.15.38:45672) 2024-04-15T14:59:54.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.387+0000 7fcf63fff640 1 -- 172.21.15.38:0/3323251441 learned_addr learned my addr 172.21.15.38:0/3323251441 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.389+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368593927 0 0) 0x7fcf640b0b00 con 0x7fcf64144c10 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.389+0000 7fcf637fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.389+0000 7fcf637fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.389+0000 7fcf637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.389+0000 7fcf637fe640 10 monclient(hunting): my global_id is 4300 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.389+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf50003520 con 0x7fcf64144c10 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019260199 0 0) 0x7fcf640b1dd0 con 0x7fcf6413e850 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:54.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 10 monclient(hunting): my global_id is 4311 2024-04-15T14:59:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf640b0b00 con 0x7fcf6413e850 2024-04-15T14:59:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986290771 0 0) 0x7fcf64073620 con 0x7fcf64072bf0 2024-04-15T14:59:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 10 monclient(hunting): my global_id is 54212 2024-04-15T14:59:54.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.390+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf640b1dd0 con 0x7fcf64072bf0 2024-04-15T14:59:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3822216742 0 0) 0x7fcf50003520 con 0x7fcf64144c10 2024-04-15T14:59:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 >> v1:172.21.15.38:6790/0 conn(0x7fcf64072bf0 legacy=0x7fcf6413e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 >> v1:172.21.15.38:6789/0 conn(0x7fcf6413e850 legacy=0x7fcf64144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 1 monclient: found mon.noname-c 2024-04-15T14:59:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:54.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640b0430 con 0x7fcf64144c10 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcf5c001990 con 0x7fcf64144c10 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf637fe640 10 monclient: dump: 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:54.397 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:54.397 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:54.397 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:54.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf6a693640 5 monclient: authenticate success, global_id 4300 2024-04-15T14:59:54.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.393+0000 7fcf6a693640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:54.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcf5c001bf0 con 0x7fcf64144c10 2024-04-15T14:59:54.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf637fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:54.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf637fe640 1 -- 172.21.15.38:0/3323251441 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcf5c001fc0 con 0x7fcf64144c10 2024-04-15T14:59:54.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf637fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf637fe640 10 monclient: dump: 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf6a693640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf6a693640 4 set_mon_vals no callback set 2024-04-15T14:59:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf6a693640 10 monclient: shutdown 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf6a693640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf6a693640 1 -- 172.21.15.38:0/3323251441 >> v1:172.21.15.164:6789/0 conn(0x7fcf64144c10 legacy=0x7fcf6414c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf6a693640 1 -- 172.21.15.38:0/3323251441 shutdown_connections 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf6a693640 1 -- 172.21.15.38:0/3323251441 >> 172.21.15.38:0/3323251441 conn(0x7fcf640b2530 msgr2=0x7fcf640b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf6a693640 1 -- 172.21.15.38:0/3323251441 shutdown_connections 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.395+0000 7fcf6a693640 1 -- 172.21.15.38:0/3323251441 wait complete. 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.396+0000 7fcf6a693640 10 monclient: build_initial_monmap 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.396+0000 7fcf6a693640 10 monclient: monmap: 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:54.401 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.396+0000 7fcf6a693640 1 librados: starting msgr at 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.396+0000 7fcf6a693640 1 librados: starting objecter 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.396+0000 7fcf6a693640 1 Processor -- start 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.396+0000 7fcf6a693640 1 -- start start 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.396+0000 7fcf6a693640 1 librados: setting wanted keys 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.396+0000 7fcf6a693640 1 librados: calling monclient init 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.396+0000 7fcf6a693640 10 monclient: init 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:54.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 10 monclient(hunting): picked mon.noname-b con 0x7fcf64072bf0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 10 monclient(hunting): picked mon.noname-a con 0x7fcf6413e850 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 10 monclient(hunting): picked mon.noname-c con 0x7fcf64144c10 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640aee00 con 0x7fcf6413e850 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640af0e0 con 0x7fcf64072bf0 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf640af3c0 con 0x7fcf64144c10 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.397+0000 7fcf6a693640 10 monclient(hunting): authenticate will time out at 1454.668953s 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.398+0000 7fcf5bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcf6413e850 0x7fcf64145350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55590/0 (socket says 172.21.15.38:55590) 2024-04-15T14:59:54.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.398+0000 7fcf5bfff640 1 -- 172.21.15.38:0/3794755828 learned_addr learned my addr 172.21.15.38:0/3794755828 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:54.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.398+0000 7fcf617fa640 10 client.?.objecter ms_handle_connect 0x7fcf6413e850 2024-04-15T14:59:54.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.398+0000 7fcf617fa640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:54.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.398+0000 7fcf617fa640 10 client.?.objecter ms_handle_connect 0x7fcf64072bf0 2024-04-15T14:59:54.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.398+0000 7fcf617fa640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.399+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980100363 0 0) 0x7fcf640af0e0 con 0x7fcf64072bf0 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.399+0000 7fcf617fa640 10 monclient(hunting): _negotiate 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.399+0000 7fcf617fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.399+0000 7fcf617fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.399+0000 7fcf617fa640 10 monclient(hunting): my global_id is 4303 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.400+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf44004eb0 con 0x7fcf64072bf0 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.400+0000 7fcf617fa640 10 client.?.objecter ms_handle_connect 0x7fcf64144c10 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.400+0000 7fcf617fa640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.400+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318943274 0 0) 0x7fcf640aee00 con 0x7fcf6413e850 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.400+0000 7fcf617fa640 10 monclient(hunting): _negotiate 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.400+0000 7fcf617fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.400+0000 7fcf617fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.400+0000 7fcf617fa640 10 monclient(hunting): my global_id is 4314 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.400+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf640af0e0 con 0x7fcf6413e850 2024-04-15T14:59:54.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.402+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932426354 0 0) 0x7fcf640af3c0 con 0x7fcf64144c10 2024-04-15T14:59:54.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.402+0000 7fcf617fa640 10 monclient(hunting): _negotiate 2024-04-15T14:59:54.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.402+0000 7fcf617fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:54.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.402+0000 7fcf617fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:54.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.402+0000 7fcf617fa640 10 monclient(hunting): my global_id is 54215 2024-04-15T14:59:54.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.402+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf640aee00 con 0x7fcf64144c10 2024-04-15T14:59:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1373764327 0 0) 0x7fcf44004eb0 con 0x7fcf64072bf0 2024-04-15T14:59:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf640af3c0 con 0x7fcf64072bf0 2024-04-15T14:59:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcf540018b0 con 0x7fcf64072bf0 2024-04-15T14:59:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:54.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 10 monclient(hunting): dump: 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4142588727 0 0) 0x7fcf640af0e0 con 0x7fcf6413e850 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf44004eb0 con 0x7fcf6413e850 2024-04-15T14:59:54.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcf4c001970 con 0x7fcf6413e850 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.405+0000 7fcf617fa640 10 monclient(hunting): dump: 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:54.409 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.407+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 85173037 0 0) 0x7fcf640aee00 con 0x7fcf64144c10 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.407+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf640af0e0 con 0x7fcf64144c10 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.407+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcf5c001f40 con 0x7fcf64144c10 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.407+0000 7fcf617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.407+0000 7fcf617fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.407+0000 7fcf617fa640 10 monclient(hunting): dump: 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:54.411 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 70243713 0 0) 0x7fcf640af3c0 con 0x7fcf64072bf0 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 >> v1:172.21.15.38:6790/0 conn(0x7fcf64144c10 legacy=0x7fcf640ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 >> v1:172.21.15.38:6789/0 conn(0x7fcf6413e850 legacy=0x7fcf64145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 10 monclient: _finish_hunting 0 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 1 monclient: found mon.b 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf640adf80 con 0x7fcf64072bf0 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 10 monclient: _finish_auth 0 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 10 monclient: _check_auth_tickets 2024-04-15T14:59:54.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf6a693640 5 monclient: authenticate success, global_id 4303 2024-04-15T14:59:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf6a693640 10 monclient: _renew_subs 2024-04-15T14:59:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf6a693640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcf640acd60 con 0x7fcf64072bf0 2024-04-15T14:59:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf6a693640 10 client.4303.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf6a693640 10 monclient: _renew_subs 2024-04-15T14:59:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf6a693640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcf641e2210 con 0x7fcf64072bf0 2024-04-15T14:59:54.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.408+0000 7fcf6a693640 1 librados: init done 2024-04-15T14:59:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.409+0000 7fcf6a693640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.409+0000 7fcf6a693640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.409+0000 7fcf6a693640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.409+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf64077050 con 0x7fcf64072bf0 2024-04-15T14:59:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.410+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcf540047e0 con 0x7fcf64072bf0 2024-04-15T14:59:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.410+0000 7fcf617fa640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:54.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.410+0000 7fcf627fc640 4 set_mon_vals no callback set 2024-04-15T14:59:54.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.425+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcf54004b30 con 0x7fcf64072bf0 2024-04-15T14:59:54.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.425+0000 7fcf617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:54.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.425+0000 7fcf617fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:54.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.425+0000 7fcf617fa640 10 monclient: dump: 2024-04-15T14:59:54.426 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:54.426 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:54.426 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.427 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:54.427 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:54.427 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:54.427 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:54.427 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:54.427 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:54.427 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:54.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.425+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fcf54004d50 con 0x7fcf64072bf0 2024-04-15T14:59:54.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.425+0000 7fcf5bfff640 10 monclient: get_auth_request con 0x7fcf4406ef20 auth_method 0 2024-04-15T14:59:54.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.426+0000 7fcf617fa640 10 client.4303.objecter ms_handle_connect 0x7fcf4406ef20 2024-04-15T14:59:54.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.427+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fcf540532f0 con 0x7fcf64072bf0 2024-04-15T14:59:54.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.427+0000 7fcf617fa640 10 client.4303.objecter ms_dispatch 0x7fcf64000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:54.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.427+0000 7fcf617fa640 3 client.4303.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:54.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.427+0000 7fcf617fa640 3 client.4303.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:54.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.427+0000 7fcf617fa640 20 client.4303.objecter dump_active .. 0 homeless 2024-04-15T14:59:54.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.660+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fcf540556f0 con 0x7fcf64072bf0 2024-04-15T14:59:54.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.660+0000 7fcf617fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:54.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.660+0000 7fcf617fa640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:54.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.886+0000 7fcf6a693640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:54.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.886+0000 7fcf6a693640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:54.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.886+0000 7fcf6a693640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:54.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.886+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf6413dce0 con 0x7fcf64072bf0 2024-04-15T14:59:54.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.948+0000 7fcf617fa640 1 -- 172.21.15.38:0/3794755828 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+12797 (unknown 634195324 0 3835457196) 0x7fcf54054ff0 con 0x7fcf64072bf0 2024-04-15T14:59:54.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.948+0000 7fcf617fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T14:59:54.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.948+0000 7fcf617fa640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:54.951 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:59:54.951 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T14:59:53.572488+0000","last_up_change":"2024-04-15T14:59:46.146485+0000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T14:59:35.434715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T14:59:51.069858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6805","nonce":3048929997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6807","nonce":3048929997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6810","nonce":3048929997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6808","nonce":3048929997}]},"public_addr":"172.21.15.38:6805/3048929997","cluster_addr":"172.21.15.38:6807/3048929997","heartbeat_back_addr":"172.21.15.38:6810/3048929997","heartbeat_front_addr":"172.21.15.38:6808/3048929997","state":["exists","up"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6806","nonce":3103013511}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6809","nonce":3103013511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6812","nonce":3103013511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6811","nonce":3103013511}]},"public_addr":"172.21.15.38:6806/3103013511","cluster_addr":"172.21.15.38:6809/3103013511","heartbeat_back_addr":"172.21.15.38:6812/3103013511","heartbeat_front_addr":"172.21.15.38:6811/3103013511","state":["exists","up"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6801","nonce":2505059545}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6802","nonce":2505059545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6804","nonce":2505059545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6803","nonce":2505059545}]},"public_addr":"172.21.15.38:6801/2505059545","cluster_addr":"172.21.15.38:6802/2505059545","heartbeat_back_addr":"172.21.15.38:6804/2505059545","heartbeat_front_addr":"172.21.15.38:6803/2505059545","state":["exists","up"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6813","nonce":2746933626}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6814","nonce":2746933626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6816","nonce":2746933626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6815","nonce":2746933626}]},"public_addr":"172.21.15.38:6813/2746933626","cluster_addr":"172.21.15.38:6814/2746933626","heartbeat_back_addr":"172.21.15.38:6816/2746933626","heartbeat_front_addr":"172.21.15.38:6815/2746933626","state":["exists","up"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6812","nonce":1135451953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6813","nonce":1135451953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6815","nonce":1135451953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6814","nonce":1135451953}]},"public_addr":"172.21.15.164:6812/1135451953","cluster_addr":"172.21.15.164:6813/1135451953","heartbeat_back_addr":"172.21.15.164:6815/1135451953","heartbeat_front_addr":"172.21.15.164:6814/1135451953","state":["exists","up"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6804","nonce":350713352}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6805","nonce":350713352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6807","nonce":350713352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6806","nonce":350713352}]},"public_addr":"172.21.15.164:6804/350713352","cluster_addr":"172.21.15.164:6805/350713352","heartbeat_back_addr":"172.21.15.164:6807/350713352","heartbeat_front_addr":"172.21.15.164:6806/350713352","state":["exists","up"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6808","nonce":3078148286}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6809","nonce":3078148286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6811","nonce":3078148286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6810","nonce":3078148286}]},"public_addr":"172.21.15.164:6808/3078148286","cluster_addr":"172.21.15.164:6809/3078148286","heartbeat_back_addr":"172.21.15.164:6811/3078148286","heartbeat_front_addr":"172.21.15.164:6810/3078148286","state":["exists","up"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6800","nonce":3353977755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6801","nonce":3353977755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6803","nonce":3353977755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6802","nonce":3353977755}]},"public_addr":"172.21.15.164:6800/3353977755","cluster_addr":"172.21.15.164:6801/3353977755","heartbeat_back_addr":"172.21.15.164:6803/3353977755","heartbeat_front_addr":"172.21.15.164:6802/3353977755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.779245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.754228+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.720273+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.101812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:30.038226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:30.010400+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.842035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.987364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T14:59:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 10 librados: watch_flush enter 2024-04-15T14:59:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 10 librados: watch_flush exit 2024-04-15T14:59:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 20 client.4303.objecter shutdown clearing up homeless session... 2024-04-15T14:59:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 10 client.4303.objecter successfully canceled tick 2024-04-15T14:59:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 >> v1:172.21.15.38:6800/1608957829 conn(0x7fcf4406ef20 legacy=0x7fcf440713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:54.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 10 monclient: shutdown 2024-04-15T14:59:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 >> v1:172.21.15.164:6789/0 conn(0x7fcf64072bf0 legacy=0x7fcf640ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 shutdown_connections 2024-04-15T14:59:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 >> 172.21.15.38:0/3794755828 conn(0x7fcf640b2530 msgr2=0x7fcf6406d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 shutdown_connections 2024-04-15T14:59:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.950+0000 7fcf6a693640 1 -- 172.21.15.38:0/3794755828 wait complete. 2024-04-15T14:59:54.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:54.951+0000 7fcf6a693640 1 librados: shutdown 2024-04-15T14:59:54.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-15T14:59:54.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-15T14:59:54.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-15T14:59:54.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-15T14:59:54.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-15T14:59:54.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-15T14:59:54.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-15T14:59:54.967 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-15T14:59:55.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.148+0000 7fc60878d640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.148+0000 7fc60878d640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.148+0000 7fc60878d640 10 monclient: monmap: 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.150288+0000 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.150288+0000 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.151 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.152 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.149+0000 7fc60878d640 1 Processor -- start 2024-04-15T14:59:55.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.149+0000 7fc60878d640 1 -- start start 2024-04-15T14:59:55.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.149+0000 7fc60878d640 10 monclient: init 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7f2c8ea17640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7f2c8ea17640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7f2c8ea17640 10 monclient: monmap: 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.152352+0000 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.152352+0000 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.153 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:55.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7f087d4a1640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7f087d4a1640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7f087d4a1640 10 monclient: monmap: 2024-04-15T14:59:55.154 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.157 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.157 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.152368+0000 2024-04-15T14:59:55.157 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.152368+0000 2024-04-15T14:59:55.157 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.157 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.157 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.157 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.158 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.158 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 10 monclient(hunting): picked mon.noname-a con 0x7fc5f80389e0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 10 monclient(hunting): picked mon.noname-c con 0x7fc5f8038dc0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 10 monclient(hunting): picked mon.noname-b con 0x7fc5f8030660 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f8036430 con 0x7fc5f80389e0 2024-04-15T14:59:55.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f8039840 con 0x7fc5f8038dc0 2024-04-15T14:59:55.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f8035690 con 0x7fc5f8030660 2024-04-15T14:59:55.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.150+0000 7fc60878d640 10 monclient(hunting): authenticate will time out at 1455.422341s 2024-04-15T14:59:55.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.151+0000 7fc605d28640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc5f8038dc0 0x7fc5f80cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:36778/0 (socket says 172.21.15.38:36778) 2024-04-15T14:59:55.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.151+0000 7fc605d28640 1 -- 172.21.15.38:0/1410637631 learned_addr learned my addr 172.21.15.38:0/1410637631 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.151+0000 7f2c8ea17640 1 Processor -- start 2024-04-15T14:59:55.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.152+0000 7f2c8ea17640 1 -- start start 2024-04-15T14:59:55.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.152+0000 7f2c8ea17640 10 monclient: init 2024-04-15T14:59:55.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.151+0000 7ff40f08f640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.151+0000 7ff40f08f640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.151+0000 7ff40f08f640 10 monclient: monmap: 2024-04-15T14:59:55.161 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.152901+0000 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.152901+0000 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.152+0000 7ff40f08f640 1 Processor -- start 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.152+0000 7ff40f08f640 1 -- start start 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.152+0000 7ff40f08f640 10 monclient: init 2024-04-15T14:59:55.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 10 monclient(hunting): picked mon.noname-c con 0x7f2c80006890 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 10 monclient(hunting): picked mon.noname-a con 0x7f2c80006c70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 10 monclient(hunting): picked mon.noname-b con 0x7f2c8002b4c0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c8002c830 con 0x7f2c80006c70 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c8002afa0 con 0x7f2c80006890 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c8002aba0 con 0x7f2c8002b4c0 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f2c8ea17640 10 monclient(hunting): authenticate will time out at 1455.424734s 2024-04-15T14:59:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 10 monclient(hunting): picked mon.noname-b con 0x7ff40002b0c0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 10 monclient(hunting): picked mon.noname-a con 0x7ff400006970 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 10 monclient(hunting): picked mon.noname-c con 0x7ff4000e2560 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff400006db0 con 0x7ff400006970 2024-04-15T14:59:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40002a460 con 0x7ff4000e2560 2024-04-15T14:59:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40002a630 con 0x7ff40002b0c0 2024-04-15T14:59:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7ff40f08f640 10 monclient(hunting): authenticate will time out at 1455.424983s 2024-04-15T14:59:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.154+0000 7f2c8e216640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f2c8002b4c0 0x7f2c800cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45702/0 (socket says 172.21.15.38:45702) 2024-04-15T14:59:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.154+0000 7f2c8e216640 1 -- 172.21.15.38:0/4210701364 learned_addr learned my addr 172.21.15.38:0/4210701364 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.153+0000 7f087d4a1640 1 Processor -- start 2024-04-15T14:59:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.154+0000 7f087d4a1640 1 -- start start 2024-04-15T14:59:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.154+0000 7f087d4a1640 10 monclient: init 2024-04-15T14:59:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151142579 0 0) 0x7fc5f8039840 con 0x7fc5f8038dc0 2024-04-15T14:59:55.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7fc605527640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7fc605527640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7fc605527640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7fc605527640 10 monclient(hunting): my global_id is 4306 2024-04-15T14:59:55.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5ec003520 con 0x7fc5f8038dc0 2024-04-15T14:59:55.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:55.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 10 monclient(hunting): picked mon.noname-b con 0x7f0870006890 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 10 monclient(hunting): picked mon.noname-c con 0x7f0870006c70 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 10 monclient(hunting): picked mon.noname-a con 0x7f087002b4c0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f087002c830 con 0x7f087002b4c0 2024-04-15T14:59:55.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f087002afa0 con 0x7f0870006c70 2024-04-15T14:59:55.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f087002aba0 con 0x7f0870006890 2024-04-15T14:59:55.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7f087d4a1640 10 monclient(hunting): authenticate will time out at 1455.426642s 2024-04-15T14:59:55.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7ff40d62c640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff4000e2560 0x7ff4000e29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:36784/0 (socket says 172.21.15.38:36784) 2024-04-15T14:59:55.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.155+0000 7ff40d62c640 1 -- 172.21.15.38:0/3550078350 learned_addr learned my addr 172.21.15.38:0/3550078350 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.157+0000 7f08767fc640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0870006c70 0x7f08700c6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:36794/0 (socket says 172.21.15.38:36794) 2024-04-15T14:59:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.157+0000 7f08767fc640 1 -- 172.21.15.38:0/504365262 learned_addr learned my addr 172.21.15.38:0/504365262 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.157+0000 7f3f9e96b640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.157+0000 7f3f9e96b640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.157+0000 7f3f9e96b640 10 monclient: monmap: 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.159137+0000 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.159137+0000 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.158+0000 7f3f9e96b640 1 Processor -- start 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.158+0000 7f3f9e96b640 1 -- start start 2024-04-15T14:59:55.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.158+0000 7f3f9e96b640 10 monclient: init 2024-04-15T14:59:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.158+0000 7fcaf9b8e640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.158+0000 7fcaf9b8e640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.158+0000 7fcaf9b8e640 10 monclient: monmap: 2024-04-15T14:59:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.160439+0000 2024-04-15T14:59:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.160439+0000 2024-04-15T14:59:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.170 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.171 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.171 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.171 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.171 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:55.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 10 monclient(hunting): picked mon.noname-b con 0x7f3f980b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 10 monclient(hunting): picked mon.noname-c con 0x7f3f980b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 10 monclient(hunting): picked mon.noname-a con 0x7f3f98146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f98140ca0 con 0x7f3f98146d70 2024-04-15T14:59:55.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f980ab0e0 con 0x7f3f980b5b90 2024-04-15T14:59:55.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f980b3310 con 0x7f3f980b57b0 2024-04-15T14:59:55.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7fcaf9b8e640 1 Processor -- start 2024-04-15T14:59:55.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7f3f9e96b640 10 monclient(hunting): authenticate will time out at 1455.430967s 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7fcaf9b8e640 1 -- start start 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.159+0000 7fcaf9b8e640 10 monclient: init 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 10 monclient(hunting): picked mon.noname-b con 0x7fcaf40b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 10 monclient(hunting): picked mon.noname-c con 0x7fcaf40b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 10 monclient(hunting): picked mon.noname-a con 0x7fcaf4146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf4140ca0 con 0x7fcaf4146d70 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40ab0e0 con 0x7fcaf40b5b90 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40b3310 con 0x7fcaf40b57b0 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.160+0000 7fcaf9b8e640 10 monclient(hunting): authenticate will time out at 1455.431939s 2024-04-15T14:59:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267864202 0 0) 0x7fc5f0001040 con 0x7fc5f80389e0 2024-04-15T14:59:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7fc605527640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7fc605527640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7fc605527640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7fc605527640 10 monclient(hunting): my global_id is 4317 2024-04-15T14:59:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5f8039840 con 0x7fc5f80389e0 2024-04-15T14:59:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 144505384 0 0) 0x7f2c8002c830 con 0x7f2c80006c70 2024-04-15T14:59:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7f2c8ca13640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7f2c8ca13640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7f2c8ca13640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7f2c8ca13640 10 monclient(hunting): my global_id is 4320 2024-04-15T14:59:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.161+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c74003520 con 0x7f2c80006c70 2024-04-15T14:59:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.162+0000 7f3f9cf08640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3f98146d70 0x7f3f9814ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55626/0 (socket says 172.21.15.38:55626) 2024-04-15T14:59:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.162+0000 7f3f9cf08640 1 -- 172.21.15.38:0/3886366002 learned_addr learned my addr 172.21.15.38:0/3886366002 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714652425 0 0) 0x7f2c8002aba0 con 0x7f2c8002b4c0 2024-04-15T14:59:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7f2c8ca13640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7f2c8ca13640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7f2c8ca13640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7f2c8ca13640 10 monclient(hunting): my global_id is 54218 2024-04-15T14:59:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c8002c830 con 0x7f2c8002b4c0 2024-04-15T14:59:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2533365709 0 0) 0x7ff40002a630 con 0x7ff40002b0c0 2024-04-15T14:59:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7ff4077fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7ff4077fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7ff4077fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7ff4077fe640 10 monclient(hunting): my global_id is 54224 2024-04-15T14:59:55.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.163+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3f0003520 con 0x7ff40002b0c0 2024-04-15T14:59:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876373041 0 0) 0x7f2c8002afa0 con 0x7f2c80006890 2024-04-15T14:59:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7f2c8ca13640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7f2c8ca13640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7f2c8ca13640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7f2c8ca13640 10 monclient(hunting): my global_id is 4312 2024-04-15T14:59:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c74003a10 con 0x7f2c80006890 2024-04-15T14:59:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4021231274 0 0) 0x7ff40002a460 con 0x7ff4000e2560 2024-04-15T14:59:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7ff4077fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7ff4077fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7ff4077fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7ff4077fe640 10 monclient(hunting): my global_id is 4309 2024-04-15T14:59:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff40002a630 con 0x7ff4000e2560 2024-04-15T14:59:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.164+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2891472204 0 0) 0x7fc5ec003520 con 0x7fc5f8038dc0 2024-04-15T14:59:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 >> v1:172.21.15.38:6790/0 conn(0x7fc5f8030660 legacy=0x7fc5f80d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 >> v1:172.21.15.38:6789/0 conn(0x7fc5f80389e0 legacy=0x7fc5f8033520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 1 monclient: found mon.noname-c 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f8035f10 con 0x7fc5f8038dc0 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc6000502c0 con 0x7fc5f8038dc0 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7fc605527640 10 monclient: dump: 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.182 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7f0875ffb640 1 -- 172.21.15.38:0/504365262 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915072337 0 0) 0x7f087002afa0 con 0x7f0870006c70 2024-04-15T14:59:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7f0875ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7f0875ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7f0875ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7f0875ffb640 10 monclient(hunting): my global_id is 4315 2024-04-15T14:59:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.165+0000 7f0875ffb640 1 -- 172.21.15.38:0/504365262 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0860003520 con 0x7f0870006c70 2024-04-15T14:59:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.166+0000 7fcaf3fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcaf4146d70 0x7fcaf414ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55636/0 (socket says 172.21.15.38:55636) 2024-04-15T14:59:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.166+0000 7fcaf3fff640 1 -- 172.21.15.38:0/476822853 learned_addr learned my addr 172.21.15.38:0/476822853 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.167+0000 7fc60878d640 5 monclient: authenticate success, global_id 4306 2024-04-15T14:59:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.167+0000 7fc60878d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.167+0000 7f27cb6eb640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.167+0000 7f27cb6eb640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.167+0000 7f27cb6eb640 10 monclient: monmap: 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.169728+0000 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.169728+0000 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.168+0000 7f27cb6eb640 1 Processor -- start 2024-04-15T14:59:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.168+0000 7f27cb6eb640 1 -- start start 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.168+0000 7f27cb6eb640 10 monclient: init 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7ff1e569c640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7ff1e569c640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7ff1e569c640 10 monclient: monmap: 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.171345+0000 2024-04-15T14:59:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.171345+0000 2024-04-15T14:59:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.187 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 10 monclient(hunting): picked mon.noname-a con 0x7f27c40b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 10 monclient(hunting): picked mon.noname-c con 0x7f27c40b5bb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 10 monclient(hunting): picked mon.noname-b con 0x7f27c4140b30 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c4146e10 con 0x7f27c40b57d0 2024-04-15T14:59:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c40aa840 con 0x7f27c40b5bb0 2024-04-15T14:59:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c40aa460 con 0x7f27c4140b30 2024-04-15T14:59:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.169+0000 7f27cb6eb640 10 monclient(hunting): authenticate will time out at 1455.441360s 2024-04-15T14:59:55.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.170+0000 7ff1e569c640 1 Processor -- start 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.170+0000 7ff1e569c640 1 -- start start 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.170+0000 7ff1e569c640 10 monclient: init 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 10 monclient(hunting): picked mon.noname-b con 0x7ff1e00b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 10 monclient(hunting): picked mon.noname-c con 0x7ff1e00b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 10 monclient(hunting): picked mon.noname-a con 0x7ff1e0146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e0140ca0 con 0x7ff1e0146d70 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e00ab0e0 con 0x7ff1e00b5b90 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e00b3310 con 0x7ff1e00b57b0 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.171+0000 7ff1e569c640 10 monclient(hunting): authenticate will time out at 1455.442866s 2024-04-15T14:59:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 1 -- 172.21.15.38:0/504365262 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 157989518 0 0) 0x7f0860003520 con 0x7f0870006c70 2024-04-15T14:59:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 1 -- 172.21.15.38:0/504365262 >> v1:172.21.15.38:6790/0 conn(0x7f0870006890 legacy=0x7f08700c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 1 -- 172.21.15.38:0/504365262 >> v1:172.21.15.38:6789/0 conn(0x7f087002b4c0 legacy=0x7f08700cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 1 monclient: found mon.noname-c 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 1 -- 172.21.15.38:0/504365262 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08700c7450 con 0x7f0870006c70 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 1 -- 172.21.15.38:0/504365262 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f086c001610 con 0x7f0870006c70 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f087d4a1640 5 monclient: authenticate success, global_id 4315 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f087d4a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f0875ffb640 10 monclient: dump: 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.175+0000 7f087d4a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.177+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528482946 0 0) 0x7f3f98140ca0 con 0x7f3f98146d70 2024-04-15T14:59:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.177+0000 7f3f96ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.177+0000 7f3f96ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.177+0000 7f3f96ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.177+0000 7f3f96ffd640 10 monclient(hunting): my global_id is 4326 2024-04-15T14:59:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.177+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f80003520 con 0x7f3f98146d70 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2108147723 0 0) 0x7f2c8002c830 con 0x7f2c8002b4c0 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 >> v1:172.21.15.164:6789/0 conn(0x7f2c80006890 legacy=0x7f2c800c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 >> v1:172.21.15.38:6789/0 conn(0x7f2c80006c70 legacy=0x7f2c800c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 1 monclient: found mon.noname-b 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c800c7450 con 0x7f2c8002b4c0 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2c880502c0 con 0x7f2c8002b4c0 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ca13640 10 monclient: dump: 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.197 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.197 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ea17640 5 monclient: authenticate success, global_id 54218 2024-04-15T14:59:55.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7f2c8ea17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4075643854 0 0) 0x7ff3f0003520 con 0x7ff40002b0c0 2024-04-15T14:59:55.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 >> v1:172.21.15.164:6789/0 conn(0x7ff4000e2560 legacy=0x7ff4000e29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 >> v1:172.21.15.38:6789/0 conn(0x7ff400006970 legacy=0x7ff400029c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 1 monclient: found mon.noname-b 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4000eddc0 con 0x7ff40002b0c0 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff4080502c0 con 0x7ff40002b0c0 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff4077fe640 10 monclient: dump: 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff40f08f640 5 monclient: authenticate success, global_id 54224 2024-04-15T14:59:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.178+0000 7ff40f08f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.179+0000 7f27c9c88640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f27c4140b30 0x7f27c414ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45742/0 (socket says 172.21.15.38:45742) 2024-04-15T14:59:55.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.179+0000 7f27c9c88640 1 -- 172.21.15.38:0/3327766555 learned_addr learned my addr 172.21.15.38:0/3327766555 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.181+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc600063620 con 0x7fc5f8038dc0 2024-04-15T14:59:55.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.181+0000 7fc605527640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.181+0000 7fc605527640 1 -- 172.21.15.38:0/1410637631 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc6000692b0 con 0x7fc5f8038dc0 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.181+0000 7fc605527640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.181+0000 7fc605527640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.181+0000 7fc605527640 10 monclient: dump: 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.201 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.202 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.181+0000 7fc60878d640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.181+0000 7fc60878d640 4 set_mon_vals no callback set 2024-04-15T14:59:55.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788613942 0 0) 0x7f3f980ab0e0 con 0x7f3f980b5b90 2024-04-15T14:59:55.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7f3f96ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7f3f96ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7f3f96ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7f3f96ffd640 10 monclient(hunting): my global_id is 4321 2024-04-15T14:59:55.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f98140ca0 con 0x7f3f980b5b90 2024-04-15T14:59:55.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7ff1d7fff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff1e00b5b90 0x7ff1e0146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:36822/0 (socket says 172.21.15.38:36822) 2024-04-15T14:59:55.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7ff1d7fff640 1 -- 172.21.15.38:0/297204371 learned_addr learned my addr 172.21.15.38:0/297204371 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7fc60878d640 10 monclient: shutdown 2024-04-15T14:59:55.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7fc60878d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7fc60878d640 1 -- 172.21.15.38:0/1410637631 >> v1:172.21.15.164:6789/0 conn(0x7fc5f8038dc0 legacy=0x7fc5f80cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7fc60878d640 1 -- 172.21.15.38:0/1410637631 shutdown_connections 2024-04-15T14:59:55.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.182+0000 7fc60878d640 1 -- 172.21.15.38:0/1410637631 >> 172.21.15.38:0/1410637631 conn(0x7fc5f8005c00 msgr2=0x7fc5f8006010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.183+0000 7fc60878d640 1 -- 172.21.15.38:0/1410637631 shutdown_connections 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.183+0000 7fc60878d640 1 -- 172.21.15.38:0/1410637631 wait complete. 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fc60878d640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fc60878d640 10 monclient: monmap: 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.205 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 453528060 0 0) 0x7fcaf40ab0e0 con 0x7fcaf40b5b90 2024-04-15T14:59:55.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fcaf27fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fcaf27fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fcaf27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fcaf27fc640 10 monclient(hunting): my global_id is 4318 2024-04-15T14:59:55.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcadc003520 con 0x7fcaf40b5b90 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fc60878d640 1 librados: starting msgr at 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fc60878d640 1 librados: starting objecter 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.184+0000 7fc60878d640 1 Processor -- start 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.185+0000 7fc60878d640 1 -- start start 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.185+0000 7fc60878d640 1 librados: setting wanted keys 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.185+0000 7fc60878d640 1 librados: calling monclient init 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.185+0000 7fc60878d640 10 monclient: init 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.185+0000 7fc60878d640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.185+0000 7fc60878d640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.186+0000 7fc60878d640 10 monclient(hunting): picked mon.noname-a con 0x7fc5f8030660 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.186+0000 7fc60878d640 10 monclient(hunting): picked mon.noname-c con 0x7fc5f80389e0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.186+0000 7fc60878d640 10 monclient(hunting): picked mon.noname-b con 0x7fc5f80c61d0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.186+0000 7fc60878d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f80c6ef0 con 0x7fc5f8030660 2024-04-15T14:59:55.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.186+0000 7fc60878d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f81615b0 con 0x7fc5f80c61d0 2024-04-15T14:59:55.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.186+0000 7fc60878d640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f80c7160 con 0x7fc5f80389e0 2024-04-15T14:59:55.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.186+0000 7fc60878d640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.186+0000 7fc60878d640 10 monclient(hunting): authenticate will time out at 1455.457714s 2024-04-15T14:59:55.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.187+0000 7f0875ffb640 1 -- 172.21.15.38:0/504365262 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f086c001870 con 0x7f0870006c70 2024-04-15T14:59:55.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.187+0000 7f0875ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.187+0000 7f0875ffb640 1 -- 172.21.15.38:0/504365262 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f086c001c80 con 0x7f0870006c70 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.187+0000 7f0875ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.187+0000 7f0875ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.187+0000 7f0875ffb640 10 monclient: dump: 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.210 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.187+0000 7f087d4a1640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.187+0000 7f087d4a1640 4 set_mon_vals no callback set 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7f087d4a1640 10 monclient: shutdown 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7f087d4a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7f087d4a1640 1 -- 172.21.15.38:0/504365262 >> v1:172.21.15.164:6789/0 conn(0x7f0870006c70 legacy=0x7f08700c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4080505a0 con 0x7ff40002b0c0 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7ff4077fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7ff4077fe640 1 -- 172.21.15.38:0/3550078350 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff4080692b0 con 0x7ff40002b0c0 2024-04-15T14:59:55.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7ff4077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7ff4077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7ff4077fe640 10 monclient: dump: 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7ff40f08f640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7ff40f08f640 4 set_mon_vals no callback set 2024-04-15T14:59:55.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c88063620 con 0x7f2c8002b4c0 2024-04-15T14:59:55.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7f2c8ca13640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7f2c8ca13640 1 -- 172.21.15.38:0/4210701364 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2c88050c40 con 0x7f2c8002b4c0 2024-04-15T14:59:55.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7f2c8ea17640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7f2c8ea17640 4 set_mon_vals no callback set 2024-04-15T14:59:55.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.188+0000 7f2c8ca13640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f2c8ca13640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f2c8ca13640 10 monclient: dump: 2024-04-15T14:59:55.213 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f087d4a1640 1 -- 172.21.15.38:0/504365262 shutdown_connections 2024-04-15T14:59:55.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f087d4a1640 1 -- 172.21.15.38:0/504365262 >> 172.21.15.38:0/504365262 conn(0x7f08700058f0 msgr2=0x7f0870005d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f087d4a1640 1 -- 172.21.15.38:0/504365262 shutdown_connections 2024-04-15T14:59:55.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f087d4a1640 1 -- 172.21.15.38:0/504365262 wait complete. 2024-04-15T14:59:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1135351770 0 0) 0x7f27c40aa840 con 0x7f27c40b5bb0 2024-04-15T14:59:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f27bbfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f27bbfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f27bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f27bbfff640 10 monclient(hunting): my global_id is 4324 2024-04-15T14:59:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b0003520 con 0x7f27c40b5bb0 2024-04-15T14:59:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f2c8ea17640 10 monclient: shutdown 2024-04-15T14:59:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f2c8ea17640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f2c8ea17640 1 -- 172.21.15.38:0/4210701364 >> v1:172.21.15.38:6790/0 conn(0x7f2c8002b4c0 legacy=0x7f2c800cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7f2c8ea17640 1 -- 172.21.15.38:0/4210701364 shutdown_connections 2024-04-15T14:59:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f2c8ea17640 1 -- 172.21.15.38:0/4210701364 >> 172.21.15.38:0/4210701364 conn(0x7f2c800058f0 msgr2=0x7f2c80005d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7ff40f08f640 10 monclient: shutdown 2024-04-15T14:59:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 71446251 0 0) 0x7f27c40aa460 con 0x7f27c4140b30 2024-04-15T14:59:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f27bbfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f27bbfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f27bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f27bbfff640 10 monclient(hunting): my global_id is 54233 2024-04-15T14:59:55.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27c40aa840 con 0x7f27c4140b30 2024-04-15T14:59:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7ff40f08f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.189+0000 7ff40f08f640 1 -- 172.21.15.38:0/3550078350 >> v1:172.21.15.38:6790/0 conn(0x7ff40002b0c0 legacy=0x7ff4000e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f087d4a1640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432947438 0 0) 0x7fcaf40b3310 con 0x7fcaf40b57b0 2024-04-15T14:59:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7fcaf27fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7fcaf27fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7fcaf27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7fcaf27fc640 10 monclient(hunting): my global_id is 54230 2024-04-15T14:59:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcadc003880 con 0x7fcaf40b57b0 2024-04-15T14:59:55.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff1de7fc640 1 -- 172.21.15.38:0/297204371 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627094361 0 0) 0x7ff1e00ab0e0 con 0x7ff1e00b5b90 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff1de7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff1de7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff1de7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff1de7fc640 10 monclient(hunting): my global_id is 4327 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff1de7fc640 1 -- 172.21.15.38:0/297204371 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1cc003520 con 0x7ff1e00b5b90 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f087d4a1640 10 monclient: monmap: 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.220 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.221 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.221 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.221 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.221 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.221 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f2c8ea17640 1 -- 172.21.15.38:0/4210701364 shutdown_connections 2024-04-15T14:59:55.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7f2c8ea17640 1 -- 172.21.15.38:0/4210701364 wait complete. 2024-04-15T14:59:55.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff40f08f640 1 -- 172.21.15.38:0/3550078350 shutdown_connections 2024-04-15T14:59:55.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff40f08f640 1 -- 172.21.15.38:0/3550078350 >> 172.21.15.38:0/3550078350 conn(0x7ff400005920 msgr2=0x7ff400005d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f087d4a1640 1 librados: starting msgr at 2024-04-15T14:59:55.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f087d4a1640 1 librados: starting objecter 2024-04-15T14:59:55.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff40f08f640 1 -- 172.21.15.38:0/3550078350 shutdown_connections 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.190+0000 7ff40f08f640 1 -- 172.21.15.38:0/3550078350 wait complete. 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f2c8ea17640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f2c8ea17640 10 monclient: monmap: 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.224 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f087d4a1640 1 Processor -- start 2024-04-15T14:59:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7fc606529640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc5f8030660 0x7fc5f80c78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55658/0 (socket says 172.21.15.38:55658) 2024-04-15T14:59:55.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7fc606529640 1 -- 172.21.15.38:0/1823909852 learned_addr learned my addr 172.21.15.38:0/1823909852 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f087d4a1640 1 -- start start 2024-04-15T14:59:55.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f087d4a1640 1 librados: setting wanted keys 2024-04-15T14:59:55.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f087d4a1640 1 librados: calling monclient init 2024-04-15T14:59:55.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2240202527 0 0) 0x7f3f80003520 con 0x7f3f98146d70 2024-04-15T14:59:55.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 >> v1:172.21.15.38:6790/0 conn(0x7f3f980b57b0 legacy=0x7f3f98140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 >> v1:172.21.15.164:6789/0 conn(0x7f3f980b5b90 legacy=0x7f3f98146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 1 monclient: found mon.noname-a 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f980aa460 con 0x7f3f98146d70 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f3f90001990 con 0x7f3f98146d70 2024-04-15T14:59:55.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f3f96ffd640 10 monclient: dump: 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.227 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f087d4a1640 10 monclient: init 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7ff40f08f640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7ff40f08f640 10 monclient: monmap: 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.228 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f2c8ea17640 1 librados: starting msgr at 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.191+0000 7f2c8ea17640 1 librados: starting objecter 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f2c8ea17640 1 Processor -- start 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f2c8ea17640 1 -- start start 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f2c8ea17640 1 librados: setting wanted keys 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f2c8ea17640 1 librados: calling monclient init 2024-04-15T14:59:55.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f2c8ea17640 10 monclient: init 2024-04-15T14:59:55.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 654862505 0 0) 0x7fcaf4140ca0 con 0x7fcaf4146d70 2024-04-15T14:59:55.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7fcaf27fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7fcaf27fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7fcaf27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7fcaf27fc640 10 monclient(hunting): my global_id is 4332 2024-04-15T14:59:55.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaf40b3310 con 0x7fcaf4146d70 2024-04-15T14:59:55.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f3f9e96b640 5 monclient: authenticate success, global_id 4326 2024-04-15T14:59:55.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f3f9e96b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7ff40f08f640 1 librados: starting msgr at 2024-04-15T14:59:55.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7ff40f08f640 1 librados: starting objecter 2024-04-15T14:59:55.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7ff40f08f640 1 Processor -- start 2024-04-15T14:59:55.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f2c8ea17640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.192+0000 7f2c8ea17640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:55.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f2c8ea17640 10 monclient(hunting): picked mon.noname-c con 0x7f2c80006890 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7ff40f08f640 1 -- start start 2024-04-15T14:59:55.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7ff40f08f640 1 librados: setting wanted keys 2024-04-15T14:59:55.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7ff40f08f640 1 librados: calling monclient init 2024-04-15T14:59:55.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7ff40f08f640 10 monclient: init 2024-04-15T14:59:55.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f2c8ea17640 10 monclient(hunting): picked mon.noname-b con 0x7f2c8002b4c0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f2c8ea17640 10 monclient(hunting): picked mon.noname-a con 0x7f2c800bfdd0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f2c8ea17640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c80161980 con 0x7f2c800bfdd0 2024-04-15T14:59:55.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f2c8ea17640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c8014eab0 con 0x7f2c8002b4c0 2024-04-15T14:59:55.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f2c8ea17640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c8014d0b0 con 0x7f2c80006890 2024-04-15T14:59:55.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f2c8ea17640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f2c8ea17640 10 monclient(hunting): authenticate will time out at 1455.464674s 2024-04-15T14:59:55.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7fc5f6ffd640 10 client.?.objecter ms_handle_connect 0x7fc5f8030660 2024-04-15T14:59:55.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7fc5f6ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7ff40f08f640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7ff40f08f640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:55.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7ff40f08f640 10 monclient(hunting): picked mon.noname-a con 0x7ff400006970 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7ff40f08f640 10 monclient(hunting): picked mon.noname-c con 0x7ff40002b0c0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.194+0000 7ff40f08f640 10 monclient(hunting): picked mon.noname-b con 0x7ff4000e2560 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.194+0000 7ff40f08f640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4000f9860 con 0x7ff400006970 2024-04-15T14:59:55.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.194+0000 7ff40f08f640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff400032a40 con 0x7ff4000e2560 2024-04-15T14:59:55.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.194+0000 7ff40f08f640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40002de40 con 0x7ff40002b0c0 2024-04-15T14:59:55.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.194+0000 7ff40f08f640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.194+0000 7ff40f08f640 10 monclient(hunting): authenticate will time out at 1455.465534s 2024-04-15T14:59:55.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:55.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 10 monclient(hunting): picked mon.noname-b con 0x7f0870006890 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 10 monclient(hunting): picked mon.noname-a con 0x7f087002b4c0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 10 monclient(hunting): picked mon.noname-c con 0x7f08700b7a00 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08700bd890 con 0x7f087002b4c0 2024-04-15T14:59:55.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08700bdb00 con 0x7f0870006890 2024-04-15T14:59:55.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08700b5760 con 0x7f08700b7a00 2024-04-15T14:59:55.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.193+0000 7f087d4a1640 10 monclient(hunting): authenticate will time out at 1455.465312s 2024-04-15T14:59:55.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.196+0000 7fc5f6ffd640 10 client.?.objecter ms_handle_connect 0x7fc5f80c61d0 2024-04-15T14:59:55.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.196+0000 7fc5f6ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.197+0000 7ff407fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7ff40002b0c0 0x7ff4000f8a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45774/0 (socket says 172.21.15.38:45774) 2024-04-15T14:59:55.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.197+0000 7ff407fff640 1 -- 172.21.15.38:0/434964162 learned_addr learned my addr 172.21.15.38:0/434964162 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 810594809 0 0) 0x7fcadc003520 con 0x7fcaf40b5b90 2024-04-15T14:59:55.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 >> v1:172.21.15.38:6790/0 conn(0x7fcaf40b57b0 legacy=0x7fcaf4140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 >> v1:172.21.15.38:6789/0 conn(0x7fcaf4146d70 legacy=0x7fcaf414ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 1 monclient: found mon.noname-c 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf40aa460 con 0x7fcaf40b5b90 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcae80015f0 con 0x7fcaf40b5b90 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf27fc640 10 monclient: dump: 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.238 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf9b8e640 5 monclient: authenticate success, global_id 4318 2024-04-15T14:59:55.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.200+0000 7fcaf9b8e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.201+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565977322 0 0) 0x7f27c4146e10 con 0x7f27c40b57d0 2024-04-15T14:59:55.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.201+0000 7f27bbfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.201+0000 7f27bbfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.201+0000 7f27bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.201+0000 7f27bbfff640 10 monclient(hunting): my global_id is 4335 2024-04-15T14:59:55.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.201+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b0003a10 con 0x7f27c40b57d0 2024-04-15T14:59:55.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7f2c8da15640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f2c80006890 0x7f2c80161270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45760/0 (socket says 172.21.15.38:45760) 2024-04-15T14:59:55.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7f2c8da15640 1 -- 172.21.15.38:0/1696221308 learned_addr learned my addr 172.21.15.38:0/1696221308 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 1 -- 172.21.15.38:0/297204371 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 161484334 0 0) 0x7ff1cc003520 con 0x7ff1e00b5b90 2024-04-15T14:59:55.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 1 -- 172.21.15.38:0/297204371 >> v1:172.21.15.38:6790/0 conn(0x7ff1e00b57b0 legacy=0x7ff1e0140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 1 -- 172.21.15.38:0/297204371 >> v1:172.21.15.38:6789/0 conn(0x7ff1e0146d70 legacy=0x7ff1e014ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 1 monclient: found mon.noname-c 2024-04-15T14:59:55.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 1 -- 172.21.15.38:0/297204371 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e00aa460 con 0x7ff1e00b5b90 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 1 -- 172.21.15.38:0/297204371 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff1c80015f0 con 0x7ff1e00b5b90 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1de7fc640 10 monclient: dump: 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.242 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.243 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.243 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.243 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.243 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.243 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1e569c640 5 monclient: authenticate success, global_id 4327 2024-04-15T14:59:55.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.203+0000 7ff1e569c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.205+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564285076 0 0) 0x7fc5f80c6ef0 con 0x7fc5f8030660 2024-04-15T14:59:55.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.205+0000 7fc5f6ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.205+0000 7fc5f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.205+0000 7fc5f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.205+0000 7fc5f6ffd640 10 monclient(hunting): my global_id is 4341 2024-04-15T14:59:55.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.205+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5e4004eb0 con 0x7fc5f8030660 2024-04-15T14:59:55.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.205+0000 7f2c7e7fc640 10 client.?.objecter ms_handle_connect 0x7f2c80006890 2024-04-15T14:59:55.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.205+0000 7f2c7e7fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.205+0000 7ff4057fa640 10 client.?.objecter ms_handle_connect 0x7ff40002b0c0 2024-04-15T14:59:55.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.206+0000 7ff4057fa640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.206+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596845049 0 0) 0x7fc5f81615b0 con 0x7fc5f80c61d0 2024-04-15T14:59:55.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.206+0000 7fc5f6ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.206+0000 7fc5f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.206+0000 7fc5f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.206+0000 7fc5f6ffd640 10 monclient(hunting): my global_id is 4330 2024-04-15T14:59:55.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.206+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5f80c6ef0 con 0x7fc5f80c61d0 2024-04-15T14:59:55.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.206+0000 7ff4057fa640 10 client.?.objecter ms_handle_connect 0x7ff4000e2560 2024-04-15T14:59:55.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.206+0000 7ff4057fa640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.207+0000 7fc5f6ffd640 10 client.?.objecter ms_handle_connect 0x7fc5f80389e0 2024-04-15T14:59:55.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.207+0000 7fc5f6ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.208+0000 7f2c7e7fc640 10 client.?.objecter ms_handle_connect 0x7f2c8002b4c0 2024-04-15T14:59:55.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.208+0000 7f2c7e7fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.208+0000 7f0876ffd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0870006890 0x7f0870159f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:36858/0 (socket says 172.21.15.38:36858) 2024-04-15T14:59:55.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.208+0000 7f0876ffd640 1 -- 172.21.15.38:0/3787861406 learned_addr learned my addr 172.21.15.38:0/3787861406 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.210+0000 7f085f7fe640 10 client.?.objecter ms_handle_connect 0x7f0870006890 2024-04-15T14:59:55.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.210+0000 7f085f7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3182407935 0 0) 0x7f27c40aa840 con 0x7f27c4140b30 2024-04-15T14:59:55.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 >> v1:172.21.15.164:6789/0 conn(0x7f27c40b5bb0 legacy=0x7f27c4140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 >> v1:172.21.15.38:6789/0 conn(0x7f27c40b57d0 legacy=0x7f27c4146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 1 monclient: found mon.noname-b 2024-04-15T14:59:55.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c40b2970 con 0x7f27c4140b30 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27cb6eb640 5 monclient: authenticate success, global_id 54233 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27cb6eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f27bc001930 con 0x7f27c4140b30 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27bbfff640 10 monclient: dump: 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.249 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.250 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.250 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.250 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.250 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.250 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.250 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f27cb6eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927586365 0 0) 0x7f2c8014d0b0 con 0x7f2c80006890 2024-04-15T14:59:55.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f2c7e7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f2c7e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f2c7e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f2c7e7fc640 10 monclient(hunting): my global_id is 54239 2024-04-15T14:59:55.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c6c004eb0 con 0x7f2c80006890 2024-04-15T14:59:55.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f90001bf0 con 0x7f3f98146d70 2024-04-15T14:59:55.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f3f96ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f3f96ffd640 1 -- 172.21.15.38:0/3886366002 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f3f90001fc0 con 0x7f3f98146d70 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f3f96ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f3f96ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f3f96ffd640 10 monclient: dump: 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.252 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.253 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f3f9e96b640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f3f9e96b640 4 set_mon_vals no callback set 2024-04-15T14:59:55.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f2c7e7fc640 10 client.?.objecter ms_handle_connect 0x7f2c800bfdd0 2024-04-15T14:59:55.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.211+0000 7f2c7e7fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1de7fc640 1 -- 172.21.15.38:0/297204371 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1c8001850 con 0x7ff1e00b5b90 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1de7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1de7fc640 1 -- 172.21.15.38:0/297204371 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff1c8001c60 con 0x7ff1e00b5b90 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1de7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1de7fc640 10 monclient: dump: 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.254 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.255 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1e569c640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1e569c640 4 set_mon_vals no callback set 2024-04-15T14:59:55.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7f3f9e96b640 10 monclient: shutdown 2024-04-15T14:59:55.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7f3f9e96b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7f3f9e96b640 1 -- 172.21.15.38:0/3886366002 >> v1:172.21.15.38:6789/0 conn(0x7f3f98146d70 legacy=0x7f3f9814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7f3f9e96b640 1 -- 172.21.15.38:0/3886366002 shutdown_connections 2024-04-15T14:59:55.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7f3f9e96b640 1 -- 172.21.15.38:0/3886366002 >> 172.21.15.38:0/3886366002 conn(0x7f3f98067790 msgr2=0x7f3f98067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7f3f9e96b640 1 -- 172.21.15.38:0/3886366002 shutdown_connections 2024-04-15T14:59:55.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7f3f9e96b640 1 -- 172.21.15.38:0/3886366002 wait complete. 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1e569c640 10 monclient: shutdown 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1e569c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.212+0000 7ff1e569c640 1 -- 172.21.15.38:0/297204371 >> v1:172.21.15.164:6789/0 conn(0x7ff1e00b5b90 legacy=0x7ff1e0146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.213+0000 7ff1e569c640 1 -- 172.21.15.38:0/297204371 shutdown_connections 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.213+0000 7ff1e569c640 1 -- 172.21.15.38:0/297204371 >> 172.21.15.38:0/297204371 conn(0x7ff1e0067790 msgr2=0x7ff1e0067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.213+0000 7ff1e569c640 1 -- 172.21.15.38:0/297204371 shutdown_connections 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.213+0000 7ff1e569c640 1 -- 172.21.15.38:0/297204371 wait complete. 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.213+0000 7ff1e569c640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.213+0000 7ff1e569c640 10 monclient: monmap: 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.257 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.213+0000 7f3f9e96b640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.213+0000 7f3f9e96b640 10 monclient: monmap: 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.258 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 1 librados: starting msgr at 2024-04-15T14:59:55.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 1 librados: starting objecter 2024-04-15T14:59:55.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7f3f9e96b640 1 librados: starting msgr at 2024-04-15T14:59:55.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7f3f9e96b640 1 librados: starting objecter 2024-04-15T14:59:55.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 1 Processor -- start 2024-04-15T14:59:55.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7f3f9e96b640 1 Processor -- start 2024-04-15T14:59:55.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 1 -- start start 2024-04-15T14:59:55.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 1 librados: setting wanted keys 2024-04-15T14:59:55.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 1 librados: calling monclient init 2024-04-15T14:59:55.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 10 monclient: init 2024-04-15T14:59:55.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7f3f9e96b640 1 -- start start 2024-04-15T14:59:55.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7f3f9e96b640 1 librados: setting wanted keys 2024-04-15T14:59:55.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7f3f9e96b640 1 librados: calling monclient init 2024-04-15T14:59:55.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7f3f9e96b640 10 monclient: init 2024-04-15T14:59:55.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcae8001850 con 0x7fcaf40b5b90 2024-04-15T14:59:55.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7fcaf27fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7fcaf9b8e640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7fcaf9b8e640 4 set_mon_vals no callback set 2024-04-15T14:59:55.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7fcaf27fc640 1 -- 172.21.15.38:0/476822853 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcae8001c20 con 0x7fcaf40b5b90 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7fcaf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7fcaf27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7fcaf27fc640 10 monclient: dump: 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.263 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.264 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.264 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.264 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.264 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:55.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.214+0000 7ff1e569c640 10 monclient(hunting): picked mon.noname-c con 0x7ff1e00b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff1e569c640 10 monclient(hunting): picked mon.noname-b con 0x7ff1e00b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 501843248 0 0) 0x7ff40002de40 con 0x7ff40002b0c0 2024-04-15T14:59:55.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff4057fa640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff4057fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff4057fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff4057fa640 10 monclient(hunting): my global_id is 54242 2024-04-15T14:59:55.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3f4004eb0 con 0x7ff40002b0c0 2024-04-15T14:59:55.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff1e569c640 10 monclient(hunting): picked mon.noname-a con 0x7ff1e0146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7f085f7fe640 10 client.?.objecter ms_handle_connect 0x7f08700b7a00 2024-04-15T14:59:55.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7f085f7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.266 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7f3f9e96b640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7f3f9e96b640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:55.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff1e569c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e013a8a0 con 0x7ff1e0146d70 2024-04-15T14:59:55.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff1e569c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e013cd20 con 0x7ff1e00b5b90 2024-04-15T14:59:55.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff1e569c640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e013d000 con 0x7ff1e00b57b0 2024-04-15T14:59:55.267 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff1e569c640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7ff1e569c640 10 monclient(hunting): authenticate will time out at 1455.486987s 2024-04-15T14:59:55.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7f3f9e96b640 10 monclient(hunting): picked mon.noname-a con 0x7f3f980b57b0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7fcaf9b8e640 10 monclient: shutdown 2024-04-15T14:59:55.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7fcaf9b8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/476822853 >> v1:172.21.15.164:6789/0 conn(0x7fcaf40b5b90 legacy=0x7fcaf4146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7f3f9e96b640 10 monclient(hunting): picked mon.noname-c con 0x7f3f980b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/476822853 shutdown_connections 2024-04-15T14:59:55.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/476822853 >> 172.21.15.38:0/476822853 conn(0x7fcaf4067790 msgr2=0x7fcaf4067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.215+0000 7f3f9e96b640 10 monclient(hunting): picked mon.noname-b con 0x7f3f98146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7f3f9e96b640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f980ae150 con 0x7f3f980b57b0 2024-04-15T14:59:55.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/476822853 shutdown_connections 2024-04-15T14:59:55.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/476822853 wait complete. 2024-04-15T14:59:55.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7f3f9e96b640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f980ae430 con 0x7f3f98146d70 2024-04-15T14:59:55.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7f3f9e96b640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f981463b0 con 0x7f3f980b5b90 2024-04-15T14:59:55.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7f3f9e96b640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7f3f9e96b640 10 monclient(hunting): authenticate will time out at 1455.487609s 2024-04-15T14:59:55.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7fcaf9b8e640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7fcaf9b8e640 10 monclient: monmap: 2024-04-15T14:59:55.272 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.272 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7fcaf9b8e640 1 librados: starting msgr at 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.216+0000 7fcaf9b8e640 1 librados: starting objecter 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.217+0000 7fcaf9b8e640 1 Processor -- start 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.217+0000 7fcaf9b8e640 1 -- start start 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.217+0000 7fcaf9b8e640 1 librados: setting wanted keys 2024-04-15T14:59:55.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.217+0000 7fcaf9b8e640 1 librados: calling monclient init 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.217+0000 7fcaf9b8e640 10 monclient: init 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.217+0000 7fcaf9b8e640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.217+0000 7fcaf9b8e640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.217+0000 7fcaf9b8e640 10 monclient(hunting): picked mon.noname-b con 0x7fcaf40b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.217+0000 7fcaf9b8e640 10 monclient(hunting): picked mon.noname-a con 0x7fcaf40b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.218+0000 7fcaf9b8e640 10 monclient(hunting): picked mon.noname-c con 0x7fcaf4146d70 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.218+0000 7fcaf9b8e640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf4137b90 con 0x7fcaf40b5b90 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.218+0000 7fcaf9b8e640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf4143c80 con 0x7fcaf40b57b0 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.218+0000 7fcaf9b8e640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf4136920 con 0x7fcaf4146d70 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.218+0000 7fcaf9b8e640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.218+0000 7fcaf9b8e640 10 monclient(hunting): authenticate will time out at 1455.489496s 2024-04-15T14:59:55.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261458881 0 0) 0x7f08700bdb00 con 0x7f0870006890 2024-04-15T14:59:55.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f085f7fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f085f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f085f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f085f7fe640 10 monclient(hunting): my global_id is 4339 2024-04-15T14:59:55.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0864004eb0 con 0x7f0870006890 2024-04-15T14:59:55.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275340110 0 0) 0x7ff400032a40 con 0x7ff4000e2560 2024-04-15T14:59:55.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7ff4057fa640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7ff4057fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7ff4057fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7ff4057fa640 10 monclient(hunting): my global_id is 4333 2024-04-15T14:59:55.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3f4005210 con 0x7ff4000e2560 2024-04-15T14:59:55.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209884810 0 0) 0x7f2c8014eab0 con 0x7f2c8002b4c0 2024-04-15T14:59:55.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f2c7e7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f2c7e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f2c7e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f2c7e7fc640 10 monclient(hunting): my global_id is 4336 2024-04-15T14:59:55.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.219+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c8014d0b0 con 0x7f2c8002b4c0 2024-04-15T14:59:55.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.220+0000 7f085f7fe640 10 client.?.objecter ms_handle_connect 0x7f087002b4c0 2024-04-15T14:59:55.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.220+0000 7f085f7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.220+0000 7ff4057fa640 10 client.?.objecter ms_handle_connect 0x7ff400006970 2024-04-15T14:59:55.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.220+0000 7ff4057fa640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 877082089 0 0) 0x7fc5e4004eb0 con 0x7fc5f8030660 2024-04-15T14:59:55.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5e40054d0 con 0x7fc5f8030660 2024-04-15T14:59:55.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc5f00019d0 con 0x7fc5f8030660 2024-04-15T14:59:55.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7fc5f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7fc5f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7fc5f6ffd640 10 monclient(hunting): dump: 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7fc5f6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14784555 0 0) 0x7f2c80161980 con 0x7f2c800bfdd0 2024-04-15T14:59:55.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7f2c7e7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7f2c7e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7f2c7e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7f2c7e7fc640 10 monclient(hunting): my global_id is 4344 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.222+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c8014eab0 con 0x7f2c800bfdd0 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.224+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3786920097 0 0) 0x7f2c6c004eb0 con 0x7f2c80006890 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.224+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c80161980 con 0x7f2c80006890 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.224+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2c84001940 con 0x7f2c80006890 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.224+0000 7f2c7e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.224+0000 7f2c7e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.224+0000 7f2c7e7fc640 10 monclient(hunting): dump: 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.281 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.224+0000 7f2c7e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411051928 0 0) 0x7ff4000f9860 con 0x7ff400006970 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7ff4057fa640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7ff4057fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7ff4057fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7ff4057fa640 10 monclient(hunting): my global_id is 4347 2024-04-15T14:59:55.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff400032a40 con 0x7ff400006970 2024-04-15T14:59:55.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314728711 0 0) 0x7fc5f80c7160 con 0x7fc5f80389e0 2024-04-15T14:59:55.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7fc5f6ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7fc5f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7fc5f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7fc5f6ffd640 10 monclient(hunting): my global_id is 54245 2024-04-15T14:59:55.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5e4004eb0 con 0x7fc5f80389e0 2024-04-15T14:59:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230398951 0 0) 0x7f08700bd890 con 0x7f087002b4c0 2024-04-15T14:59:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f085f7fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f085f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f085f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27bc001c90 con 0x7f27c4140b30 2024-04-15T14:59:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f27bbfff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f27cb6eb640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f27cb6eb640 4 set_mon_vals no callback set 2024-04-15T14:59:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f27bbfff640 1 -- 172.21.15.38:0/3327766555 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f27bc001790 con 0x7f27c4140b30 2024-04-15T14:59:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f27bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f27bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f085f7fe640 10 monclient(hunting): my global_id is 4350 2024-04-15T14:59:55.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f27bbfff640 10 monclient: dump: 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.226+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08700bdb00 con 0x7f087002b4c0 2024-04-15T14:59:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7ff1deffd640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7ff1e00b57b0 0x7ff1e01dc280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45786/0 (socket says 172.21.15.38:45786) 2024-04-15T14:59:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7ff1d7fff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff1e00b5b90 0x7ff1e0130b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:36872/0 (socket says 172.21.15.38:36872) 2024-04-15T14:59:55.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7ff1deffd640 1 -- 172.21.15.38:0/2042630551 learned_addr learned my addr 172.21.15.38:0/2042630551 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f27cb6eb640 10 monclient: shutdown 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f27cb6eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f27cb6eb640 1 -- 172.21.15.38:0/3327766555 >> v1:172.21.15.38:6790/0 conn(0x7f27c4140b30 legacy=0x7f27c414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f27cb6eb640 1 -- 172.21.15.38:0/3327766555 shutdown_connections 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f27cb6eb640 1 -- 172.21.15.38:0/3327766555 >> 172.21.15.38:0/3327766555 conn(0x7f27c4067790 msgr2=0x7f27c4067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18670111 0 0) 0x7f08700b5760 con 0x7f08700b7a00 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f085f7fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f085f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f085f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f085f7fe640 10 monclient(hunting): my global_id is 54248 2024-04-15T14:59:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08700bd890 con 0x7f08700b7a00 2024-04-15T14:59:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f27cb6eb640 1 -- 172.21.15.38:0/3327766555 shutdown_connections 2024-04-15T14:59:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.227+0000 7f27cb6eb640 1 -- 172.21.15.38:0/3327766555 wait complete. 2024-04-15T14:59:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f27cb6eb640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f27cb6eb640 10 monclient: monmap: 2024-04-15T14:59:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.289 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.290 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 533626703 0 0) 0x7fc5f80c6ef0 con 0x7fc5f80c61d0 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5f80c7160 con 0x7fc5f80c61d0 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc5fc001660 con 0x7fc5f80c61d0 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7fc5f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7fc5f6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7fc5f6ffd640 10 monclient(hunting): dump: 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.291 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.292 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f3f9cf08640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f3f98146d70 0x7f3f98144240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:36882/0 (socket says 172.21.15.38:36882) 2024-04-15T14:59:55.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f3f9cf08640 1 -- 172.21.15.38:0/137848201 learned_addr learned my addr 172.21.15.38:0/137848201 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f27cb6eb640 1 librados: starting msgr at 2024-04-15T14:59:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f27cb6eb640 1 librados: starting objecter 2024-04-15T14:59:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f27cb6eb640 1 Processor -- start 2024-04-15T14:59:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f27cb6eb640 1 -- start start 2024-04-15T14:59:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f27cb6eb640 1 librados: setting wanted keys 2024-04-15T14:59:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f27cb6eb640 1 librados: calling monclient init 2024-04-15T14:59:55.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.228+0000 7f27cb6eb640 10 monclient: init 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 10 monclient(hunting): picked mon.noname-a con 0x7f27c40b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 10 monclient(hunting): picked mon.noname-c con 0x7f27c40b5bb0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 10 monclient(hunting): picked mon.noname-b con 0x7f27c4140b30 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c40add40 con 0x7f27c40b57d0 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c40adfb0 con 0x7f27c4140b30 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c4141130 con 0x7f27c40b5bb0 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.229+0000 7f27cb6eb640 10 monclient(hunting): authenticate will time out at 1455.500869s 2024-04-15T14:59:55.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.232+0000 7ff1d77fe640 10 client.?.objecter ms_handle_connect 0x7ff1e0146d70 2024-04-15T14:59:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.232+0000 7ff1d77fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.234+0000 7fcaf37fe640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fcaf40b57b0 0x7fcaf41d5130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:36892/0 (socket says 172.21.15.38:36892) 2024-04-15T14:59:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.234+0000 7fcaf37fe640 1 -- 172.21.15.38:0/4112359770 learned_addr learned my addr 172.21.15.38:0/4112359770 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.235+0000 7ff1d77fe640 10 client.?.objecter ms_handle_connect 0x7ff1e00b57b0 2024-04-15T14:59:55.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.235+0000 7ff1d77fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.235+0000 7f3f94ff9640 10 client.?.objecter ms_handle_connect 0x7f3f98146d70 2024-04-15T14:59:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.235+0000 7f3f94ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7ff1d77fe640 10 client.?.objecter ms_handle_connect 0x7ff1e00b5b90 2024-04-15T14:59:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7ff1d77fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7fcadbfff640 10 client.?.objecter ms_handle_connect 0x7fcaf40b57b0 2024-04-15T14:59:55.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7fcadbfff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3135990439 0 0) 0x7ff3f4004eb0 con 0x7ff40002b0c0 2024-04-15T14:59:55.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4000f9860 con 0x7ff40002b0c0 2024-04-15T14:59:55.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff3f8001910 con 0x7ff40002b0c0 2024-04-15T14:59:55.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7ff4057fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7ff4057fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7ff4057fa640 10 monclient(hunting): dump: 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.236+0000 7ff4057fa640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.237+0000 7f3f94ff9640 10 client.?.objecter ms_handle_connect 0x7f3f980b5b90 2024-04-15T14:59:55.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.237+0000 7f3f94ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.239+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1293498203 0 0) 0x7f0864004eb0 con 0x7f0870006890 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.239+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08700b5760 con 0x7f0870006890 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.239+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f08680018d0 con 0x7f0870006890 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.239+0000 7f085f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.239+0000 7f085f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.239+0000 7f085f7fe640 10 monclient(hunting): dump: 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.300 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.301 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.301 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.301 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.301 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.301 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.239+0000 7f085f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.242+0000 7fcadbfff640 10 client.?.objecter ms_handle_connect 0x7fcaf4146d70 2024-04-15T14:59:55.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.242+0000 7fcadbfff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3770080099 0 0) 0x7ff4000f9860 con 0x7ff40002b0c0 2024-04-15T14:59:55.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 >> v1:172.21.15.164:6789/0 conn(0x7ff4000e2560 legacy=0x7ff4000f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 >> v1:172.21.15.38:6789/0 conn(0x7ff400006970 legacy=0x7ff4000d86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 1 monclient: found mon.c 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4000d81b0 con 0x7ff40002b0c0 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff4057fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff40f08f640 5 monclient: authenticate success, global_id 54242 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff40f08f640 10 monclient: _renew_subs 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff40f08f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff4000e5420 con 0x7ff40002b0c0 2024-04-15T14:59:55.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff40f08f640 10 client.54242.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff40f08f640 10 monclient: _renew_subs 2024-04-15T14:59:55.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff40f08f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff4000d8de0 con 0x7ff40002b0c0 2024-04-15T14:59:55.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7ff40f08f640 1 librados: init done 2024-04-15T14:59:55.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2892872112 0 0) 0x7f2c8014d0b0 con 0x7f2c8002b4c0 2024-04-15T14:59:55.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c6c004eb0 con 0x7f2c8002b4c0 2024-04-15T14:59:55.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2c780018d0 con 0x7f2c8002b4c0 2024-04-15T14:59:55.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7f2c7e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7f2c7e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.243+0000 7f2c7e7fc640 10 monclient(hunting): dump: 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.305 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.244+0000 7ff40f08f640 10 client.54242.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.244+0000 7ff40f08f640 15 client.54242.objecter _session_command_op_assign -1 1 2024-04-15T14:59:55.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.244+0000 7ff40f08f640 20 client.54242.objecter _get_session osd=-1 returning homeless 2024-04-15T14:59:55.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.244+0000 7ff40f08f640 10 client.54242.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.244+0000 7ff40f08f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.244+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.38:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff400004d00 con 0x7ff40002b0c0 2024-04-15T14:59:55.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597028887 0 0) 0x7ff1e013cd20 con 0x7ff1e00b5b90 2024-04-15T14:59:55.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7ff1d77fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7ff1d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7ff1d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7ff1d77fe640 10 monclient(hunting): my global_id is 4345 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c0004eb0 con 0x7ff1e00b5b90 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2203174213 0 0) 0x7fcaf4143c80 con 0x7fcaf40b57b0 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7fcadbfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7fcadbfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7fcadbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7fcadbfff640 10 monclient(hunting): my global_id is 4348 2024-04-15T14:59:55.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.245+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcae0004eb0 con 0x7fcaf40b57b0 2024-04-15T14:59:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818086375 0 0) 0x7f3f980ae430 con 0x7f3f98146d70 2024-04-15T14:59:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f3f94ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f3f94ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f3f94ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f3f94ff9640 10 monclient(hunting): my global_id is 4342 2024-04-15T14:59:55.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f84004eb0 con 0x7f3f98146d70 2024-04-15T14:59:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2023507511 0 0) 0x7fc5f80c7160 con 0x7fc5f80c61d0 2024-04-15T14:59:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 >> v1:172.21.15.38:6790/0 conn(0x7fc5f80389e0 legacy=0x7fc5f8160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 >> v1:172.21.15.38:6789/0 conn(0x7fc5f8030660 legacy=0x7fc5f80c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 1 monclient: found mon.b 2024-04-15T14:59:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80c7440 con 0x7fc5f80c61d0 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc5f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc60878d640 5 monclient: authenticate success, global_id 4330 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc60878d640 10 monclient: _renew_subs 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc60878d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f80c5650 con 0x7fc5f80c61d0 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc60878d640 10 client.4330.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc60878d640 10 monclient: _renew_subs 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc60878d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc5f80c3c00 con 0x7fc5f80c61d0 2024-04-15T14:59:55.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7fc60878d640 1 librados: init done 2024-04-15T14:59:55.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f27c8c86640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f27c40b5bb0 0x7f27c4138f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45816/0 (socket says 172.21.15.38:45816) 2024-04-15T14:59:55.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f27c8c86640 1 -- 172.21.15.38:0/857966699 learned_addr learned my addr 172.21.15.38:0/857966699 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2164693265 0 0) 0x7f2c80161980 con 0x7f2c80006890 2024-04-15T14:59:55.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 >> v1:172.21.15.164:6789/0 conn(0x7f2c8002b4c0 legacy=0x7f2c800bf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.246+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 >> v1:172.21.15.38:6789/0 conn(0x7f2c800bfdd0 legacy=0x7f2c8016cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7fc60878d640 10 client.4330.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7fc60878d640 15 client.4330.objecter _session_command_op_assign -1 1 2024-04-15T14:59:55.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7fc60878d640 20 client.4330.objecter _get_session osd=-1 returning homeless 2024-04-15T14:59:55.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7fc60878d640 10 client.4330.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7fc60878d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.312 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc5f8005120 con 0x7fc5f80c61d0 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c7e7fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c7e7fc640 1 monclient: found mon.c 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c7e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c7e7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c80158ba0 con 0x7f2c80006890 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c7e7fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c7e7fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c7e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 5 monclient: authenticate success, global_id 54239 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 10 monclient: _renew_subs 2024-04-15T14:59:55.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2c80158100 con 0x7f2c80006890 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 10 client.54239.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 10 monclient: _renew_subs 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2c80031870 con 0x7f2c80006890 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 1 librados: init done 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301356795 0 0) 0x7ff1e013d000 con 0x7ff1e00b57b0 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7ff1d77fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7ff1d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7ff1d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7ff1d77fe640 10 monclient(hunting): my global_id is 54251 2024-04-15T14:59:55.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1e013cd20 con 0x7ff1e00b57b0 2024-04-15T14:59:55.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3746592673 0 0) 0x7f3f981463b0 con 0x7f3f980b5b90 2024-04-15T14:59:55.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f3f94ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f3f94ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f3f94ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f3f94ff9640 10 monclient(hunting): my global_id is 54254 2024-04-15T14:59:55.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f980ae430 con 0x7f3f980b5b90 2024-04-15T14:59:55.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 10 client.54239.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 15 client.54239.objecter _session_command_op_assign -1 1 2024-04-15T14:59:55.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 20 client.54239.objecter _get_session osd=-1 returning homeless 2024-04-15T14:59:55.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 10 client.54239.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.38:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2c8002a520 con 0x7f2c80006890 2024-04-15T14:59:55.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.247+0000 7f27b9ffb640 10 client.?.objecter ms_handle_connect 0x7f27c40b5bb0 2024-04-15T14:59:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.248+0000 7f27b9ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.248+0000 7f3f94ff9640 10 client.?.objecter ms_handle_connect 0x7f3f980b57b0 2024-04-15T14:59:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.248+0000 7f3f94ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.253+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831072874 0 0) 0x7f3f980ae150 con 0x7f3f980b57b0 2024-04-15T14:59:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.253+0000 7f3f94ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.253+0000 7f3f94ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.253+0000 7f3f94ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.253+0000 7f3f94ff9640 10 monclient(hunting): my global_id is 4356 2024-04-15T14:59:55.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.253+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f981463b0 con 0x7f3f980b57b0 2024-04-15T14:59:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.254+0000 7fcadbfff640 10 client.?.objecter ms_handle_connect 0x7fcaf40b5b90 2024-04-15T14:59:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.254+0000 7fcadbfff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.256+0000 7f27b9ffb640 10 client.?.objecter ms_handle_connect 0x7f27c40b57d0 2024-04-15T14:59:55.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.256+0000 7f27b9ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.261+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1366304036 0 0) 0x7fcae0004eb0 con 0x7fcaf40b57b0 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.261+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcae0005340 con 0x7fcaf40b57b0 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.261+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcae4001930 con 0x7fcaf40b57b0 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.261+0000 7fcadbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.261+0000 7fcadbfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.261+0000 7fcadbfff640 10 monclient(hunting): dump: 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.319 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.320 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.261+0000 7fcadbfff640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.261+0000 7f27b9ffb640 10 client.?.objecter ms_handle_connect 0x7f27c4140b30 2024-04-15T14:59:55.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.261+0000 7f27b9ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 55732935 0 0) 0x7f08700bdb00 con 0x7f087002b4c0 2024-04-15T14:59:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0864004eb0 con 0x7f087002b4c0 2024-04-15T14:59:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f086c001bc0 con 0x7f087002b4c0 2024-04-15T14:59:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f085f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f085f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f085f7fe640 10 monclient(hunting): dump: 2024-04-15T14:59:55.321 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008569378 0 0) 0x7f27c40add40 con 0x7f27c40b57d0 2024-04-15T14:59:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f27b9ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f27b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f27b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f27b9ffb640 10 monclient(hunting): my global_id is 4362 2024-04-15T14:59:55.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27a8004eb0 con 0x7f27c40b57d0 2024-04-15T14:59:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.263+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1474781174 0 0) 0x7f08700b5760 con 0x7f0870006890 2024-04-15T14:59:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 >> v1:172.21.15.38:6790/0 conn(0x7f08700b7a00 legacy=0x7f08701567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 >> v1:172.21.15.38:6789/0 conn(0x7f087002b4c0 legacy=0x7f08700b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 1 monclient: found mon.b 2024-04-15T14:59:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0870160280 con 0x7f0870006890 2024-04-15T14:59:55.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f085f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f087d4a1640 5 monclient: authenticate success, global_id 4339 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f087d4a1640 10 monclient: _renew_subs 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f087d4a1640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f08700b5930 con 0x7f0870006890 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f087d4a1640 10 client.4339.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f087d4a1640 10 monclient: _renew_subs 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f087d4a1640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f08701570c0 con 0x7f0870006890 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.264+0000 7f087d4a1640 1 librados: init done 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.265+0000 7f087d4a1640 10 client.4339.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.265+0000 7f087d4a1640 15 client.4339.objecter _session_command_op_assign -1 1 2024-04-15T14:59:55.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.265+0000 7f087d4a1640 20 client.4339.objecter _get_session osd=-1 returning homeless 2024-04-15T14:59:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.265+0000 7f087d4a1640 10 client.4339.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.265+0000 7f087d4a1640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.265+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0870004cd0 con 0x7f0870006890 2024-04-15T14:59:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1760288666 0 0) 0x7f3f981463b0 con 0x7f3f980b57b0 2024-04-15T14:59:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f980ae150 con 0x7f3f980b57b0 2024-04-15T14:59:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f3f880014d0 con 0x7f3f980b57b0 2024-04-15T14:59:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7f3f94ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7f3f94ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7f3f94ff9640 10 monclient(hunting): dump: 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7f3f94ff9640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886504928 0 0) 0x7ff1e013a8a0 con 0x7ff1e0146d70 2024-04-15T14:59:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7ff1d77fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7ff1d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7ff1d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7ff1d77fe640 10 monclient(hunting): my global_id is 4353 2024-04-15T14:59:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.266+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1e013d000 con 0x7ff1e0146d70 2024-04-15T14:59:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.267+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600137968 0 0) 0x7fcaf4137b90 con 0x7fcaf40b5b90 2024-04-15T14:59:55.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.267+0000 7fcadbfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.267+0000 7fcadbfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.267+0000 7fcadbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.267+0000 7fcadbfff640 10 monclient(hunting): my global_id is 4359 2024-04-15T14:59:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.267+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcae0004eb0 con 0x7fcaf40b5b90 2024-04-15T14:59:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.272+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 347844456 0 0) 0x7f27a8004eb0 con 0x7f27c40b57d0 2024-04-15T14:59:55.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.272+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27c40add40 con 0x7f27c40b57d0 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.279+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2079490653 0 0) 0x7f3f84004eb0 con 0x7f3f98146d70 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.279+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f981463b0 con 0x7f3f98146d70 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.279+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f3f90001f40 con 0x7f3f98146d70 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.279+0000 7f3f94ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.279+0000 7f3f94ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.279+0000 7f3f94ff9640 10 monclient(hunting): dump: 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.331 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.332 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.279+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2347123056 0 0) 0x7fcae0005340 con 0x7fcaf40b57b0 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 >> v1:172.21.15.38:6790/0 conn(0x7fcaf4146d70 legacy=0x7fcaf41e2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 >> v1:172.21.15.38:6789/0 conn(0x7fcaf40b5b90 legacy=0x7fcaf41d5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 1 monclient: found mon.b 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf4135e80 con 0x7fcaf40b57b0 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcadbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 5 monclient: authenticate success, global_id 4348 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 10 monclient: _renew_subs 2024-04-15T14:59:55.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf4136170 con 0x7fcaf40b57b0 2024-04-15T14:59:55.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715086182 0 0) 0x7f27c40adfb0 con 0x7f27c4140b30 2024-04-15T14:59:55.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 10 client.4348.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 10 monclient: _renew_subs 2024-04-15T14:59:55.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcaf41e4400 con 0x7fcaf40b57b0 2024-04-15T14:59:55.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient(hunting): my global_id is 4351 2024-04-15T14:59:55.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27a8004eb0 con 0x7f27c4140b30 2024-04-15T14:59:55.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 1 librados: init done 2024-04-15T14:59:55.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2302928013 0 0) 0x7f3f980ae150 con 0x7f3f980b57b0 2024-04-15T14:59:55.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 >> v1:172.21.15.38:6790/0 conn(0x7f3f980b5b90 legacy=0x7f3f98143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 >> v1:172.21.15.164:6789/0 conn(0x7f3f98146d70 legacy=0x7f3f98144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 1 monclient: found mon.a 2024-04-15T14:59:55.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f98146580 con 0x7f3f980b57b0 2024-04-15T14:59:55.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f94ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f9e96b640 5 monclient: authenticate success, global_id 4356 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f9e96b640 10 monclient: _renew_subs 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f9e96b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3f980b22c0 con 0x7f3f980b57b0 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f9e96b640 10 client.4356.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f9e96b640 10 monclient: _renew_subs 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f9e96b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3f980acb30 con 0x7f3f980b57b0 2024-04-15T14:59:55.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f3f9e96b640 1 librados: init done 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f27c0001a10 con 0x7f27c40b57d0 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient(hunting): dump: 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.338 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3370268677 0 0) 0x7f27c40add40 con 0x7f27c40b57d0 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 >> v1:172.21.15.38:6790/0 conn(0x7f27c40b5bb0 legacy=0x7f27c4138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 10 client.4348.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 15 client.4348.objecter _session_command_op_assign -1 1 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 20 client.4348.objecter _get_session osd=-1 returning homeless 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 10 client.4348.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fcaf41d5f50 con 0x7fcaf40b57b0 2024-04-15T14:59:55.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 >> v1:172.21.15.164:6789/0 conn(0x7f27c4140b30 legacy=0x7f27c4141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 1 monclient: found mon.a 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c4143b50 con 0x7f27c40b57d0 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.280+0000 7f27b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f27cb6eb640 5 monclient: authenticate success, global_id 4362 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f27cb6eb640 10 monclient: _renew_subs 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f27cb6eb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f27cb6eb640 1 -- 172.21.15.38:0/857966699 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f27c4143e00 con 0x7f27c40b57d0 2024-04-15T14:59:55.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f3f9e96b640 10 client.4356.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f27cb6eb640 10 client.4362.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f3f9e96b640 15 client.4356.objecter _session_command_op_assign -1 1 2024-04-15T14:59:55.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f27cb6eb640 10 monclient: _renew_subs 2024-04-15T14:59:55.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f3f9e96b640 20 client.4356.objecter _get_session osd=-1 returning homeless 2024-04-15T14:59:55.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f3f9e96b640 10 client.4356.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f27cb6eb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f27cb6eb640 1 -- 172.21.15.38:0/857966699 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f27c4139850 con 0x7f27c40b57d0 2024-04-15T14:59:55.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f3f9e96b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.38:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3f98077050 con 0x7f3f980b57b0 2024-04-15T14:59:55.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.281+0000 7f27cb6eb640 1 librados: init done 2024-04-15T14:59:55.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.282+0000 7f27af7fe640 10 client.4362.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.282+0000 7f27af7fe640 15 client.4362.objecter _session_command_op_assign -1 1 2024-04-15T14:59:55.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.282+0000 7f27af7fe640 20 client.4362.objecter _get_session osd=-1 returning homeless 2024-04-15T14:59:55.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.282+0000 7f27af7fe640 10 client.4362.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.282+0000 7f27af7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.282+0000 7f27af7fe640 1 -- 172.21.15.38:0/857966699 --> v1:172.21.15.38:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f27c4077050 con 0x7f27c40b57d0 2024-04-15T14:59:55.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.289+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5fc001c30 con 0x7fc5f80c61d0 2024-04-15T14:59:55.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.289+0000 7fc5f6ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.289+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc5fc003790 con 0x7fc5f80c61d0 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.289+0000 7fc5f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.289+0000 7fc5f6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.289+0000 7fc5f6ffd640 10 monclient: dump: 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.289+0000 7fc604d26640 4 set_mon_vals no callback set 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.289+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fc5fc019cc0 con 0x7fc5f80c61d0 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.290+0000 7fc606529640 10 monclient: get_auth_request con 0x7fc5e406ef50 auth_method 0 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.290+0000 7fc5f6ffd640 10 client.4330.objecter ms_handle_connect 0x7fc5e406ef50 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.291+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff400004d00 con 0x7ff40002b0c0 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.291+0000 7ff4057fa640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.291+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff3f80038c0 con 0x7ff40002b0c0 2024-04-15T14:59:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.291+0000 7ff4057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.291+0000 7ff4057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.291+0000 7ff4057fa640 10 monclient: dump: 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.291+0000 7ff406ffd640 4 set_mon_vals no callback set 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fc5fc051f90 con 0x7fc5f80c61d0 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 10 client.4330.objecter ms_dispatch 0x7fc600000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 3 client.4330.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 3 client.4330.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 10 client.4330.objecter checking command 1 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 20 client.4330.objecter _get_session s=0x7fc5e40759a0 osd=5 3 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 20 client.4330.objecter put_session s=0x7fc5e40759a0 osd=5 3 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 15 client.4330.objecter _session_command_op_remove -1 1 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 20 client.4330.objecter _get_session s=0x7fc5e40759a0 osd=5 3 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 20 client.4330.objecter get_session s=0x7fc5e40759a0 osd=5 3 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 15 client.4330.objecter _session_command_op_assign 5 1 2024-04-15T14:59:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 20 client.4330.objecter put_session s=0x7fc5e40759a0 osd=5 4 2024-04-15T14:59:55.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 10 client.4330.objecter _send_command 1 2024-04-15T14:59:55.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.164:6804/350713352 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5e4079c20 con 0x7fc5e4076050 2024-04-15T14:59:55.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 20 client.4330.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fc5fc04fea0 con 0x7fc5f80c61d0 2024-04-15T14:59:55.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7fc5f6ffd640 10 monclient: handle_get_version_reply finishing 1 version 28 2024-04-15T14:59:55.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7ff3f8003a60 con 0x7ff40002b0c0 2024-04-15T14:59:55.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.292+0000 7ff40ce2b640 10 monclient: get_auth_request con 0x7ff3f406f000 auth_method 0 2024-04-15T14:59:55.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.293+0000 7ff4057fa640 10 client.54242.objecter ms_handle_connect 0x7ff3f406f000 2024-04-15T14:59:55.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.293+0000 7fc605d28640 10 monclient: get_auth_request con 0x7fc5e4076050 auth_method 0 2024-04-15T14:59:55.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.295+0000 7fc5f6ffd640 10 client.4330.objecter ms_handle_connect 0x7fc5e4076050 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.295+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 696889617 0 0) 0x7ff1c0004eb0 con 0x7ff1e00b5b90 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.295+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1e013a8a0 con 0x7ff1e00b5b90 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.295+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff1c8001a00 con 0x7ff1e00b5b90 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.295+0000 7ff1d77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.295+0000 7ff1d77fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.295+0000 7ff1d77fe640 10 monclient(hunting): dump: 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.352 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.353 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.353 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.353 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.353 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.295+0000 7ff1d77fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7ff3f8053220 con 0x7ff40002b0c0 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 10 client.54242.objecter ms_dispatch 0x7ff408000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 3 client.54242.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 3 client.54242.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 10 client.54242.objecter checking command 1 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 20 client.54242.objecter _get_session s=0x7ff3f4075a70 osd=4 3 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 20 client.54242.objecter put_session s=0x7ff3f4075a70 osd=4 3 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 15 client.54242.objecter _session_command_op_remove -1 1 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 20 client.54242.objecter _get_session s=0x7ff3f4075a70 osd=4 3 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 20 client.54242.objecter get_session s=0x7ff3f4075a70 osd=4 3 2024-04-15T14:59:55.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 15 client.54242.objecter _session_command_op_assign 4 1 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 20 client.54242.objecter put_session s=0x7ff3f4075a70 osd=4 4 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 10 client.54242.objecter _send_command 1 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.164:6812/1135451953 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3f80042b0 con 0x7ff3f4076120 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 20 client.54242.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7ff3f8051130 con 0x7ff40002b0c0 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.296+0000 7ff4057fa640 10 monclient: handle_get_version_reply finishing 1 version 28 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.297+0000 7ff40d62c640 10 monclient: get_auth_request con 0x7ff3f4076120 auth_method 0 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.300+0000 7ff4057fa640 10 client.54242.objecter ms_handle_connect 0x7ff3f4076120 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.304+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1252097520 0 0) 0x7ff1e013d000 con 0x7ff1e0146d70 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.304+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1c0004eb0 con 0x7ff1e0146d70 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.304+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff1d8001af0 con 0x7ff1e0146d70 2024-04-15T14:59:55.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.304+0000 7ff1d77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.304+0000 7ff1d77fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.304+0000 7ff1d77fe640 10 monclient(hunting): dump: 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.356 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.305+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c84001c40 con 0x7f2c80006890 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.305+0000 7f2c7e7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.305+0000 7f2c7f7fe640 4 set_mon_vals no callback set 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.306+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f2c84003a40 con 0x7f2c80006890 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.306+0000 7f2c7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.306+0000 7f2c7e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.306+0000 7f2c7e7fc640 10 monclient: dump: 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.358 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.359 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.361 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.361 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.361 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.361 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.361 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.307+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f2c84003be0 con 0x7f2c80006890 2024-04-15T14:59:55.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.307+0000 7f2c8d214640 10 monclient: get_auth_request con 0x7f2c6c06eda0 auth_method 0 2024-04-15T14:59:55.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.308+0000 7f2c7e7fc640 10 client.54239.objecter ms_handle_connect 0x7f2c6c06eda0 2024-04-15T14:59:55.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f2c84053490 con 0x7f2c80006890 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 10 client.54239.objecter ms_dispatch 0x7f2c88000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 3 client.54239.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 3 client.54239.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 10 client.54239.objecter checking command 1 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 20 client.54239.objecter _get_session s=0x7f2c6c075810 osd=0 3 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 20 client.54239.objecter put_session s=0x7f2c6c075810 osd=0 3 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 15 client.54239.objecter _session_command_op_remove -1 1 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 20 client.54239.objecter _get_session s=0x7f2c6c075810 osd=0 3 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 20 client.54239.objecter get_session s=0x7f2c6c075810 osd=0 3 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 15 client.54239.objecter _session_command_op_assign 0 1 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 20 client.54239.objecter put_session s=0x7f2c6c075810 osd=0 4 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 10 client.54239.objecter _send_command 1 2024-04-15T14:59:55.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.38:6805/3048929997 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c6c079a90 con 0x7f2c6c075ec0 2024-04-15T14:59:55.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 20 client.54239.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f2c840513a0 con 0x7f2c80006890 2024-04-15T14:59:55.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f2c7e7fc640 10 monclient: handle_get_version_reply finishing 1 version 28 2024-04-15T14:59:55.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f98077050 con 0x7f3f980b57b0 2024-04-15T14:59:55.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f3f94ff9640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f3f88001c40 con 0x7f3f980b57b0 2024-04-15T14:59:55.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f3f94ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f3f94ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f3f94ff9640 10 monclient: dump: 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.364 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.319+0000 7f2c8e216640 10 monclient: get_auth_request con 0x7f2c6c075ec0 auth_method 0 2024-04-15T14:59:55.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.318+0000 7f3f967fc640 4 set_mon_vals no callback set 2024-04-15T14:59:55.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.320+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f3f88019c20 con 0x7f3f980b57b0 2024-04-15T14:59:55.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.320+0000 7f3f977fe640 10 monclient: get_auth_request con 0x7f3f8406ee30 auth_method 0 2024-04-15T14:59:55.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.320+0000 7f3f94ff9640 10 client.4356.objecter ms_handle_connect 0x7f3f8406ee30 2024-04-15T14:59:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.321+0000 7f2c7e7fc640 10 client.54239.objecter ms_handle_connect 0x7f2c6c075ec0 2024-04-15T14:59:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.323+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 219461510 0 0) 0x7ff1e013cd20 con 0x7ff1e00b57b0 2024-04-15T14:59:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.323+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1e013d000 con 0x7ff1e00b57b0 2024-04-15T14:59:55.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.323+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff1d0001890 con 0x7ff1e00b57b0 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.323+0000 7ff1d77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.323+0000 7ff1d77fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.323+0000 7ff1d77fe640 10 monclient(hunting): dump: 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.367 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.326+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcae4001c90 con 0x7fcaf40b57b0 2024-04-15T14:59:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.326+0000 7fcadbfff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.326+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fcae4003ae0 con 0x7fcaf40b57b0 2024-04-15T14:59:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.326+0000 7fcadbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.326+0000 7fcadbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.326+0000 7fcadbfff640 10 monclient: dump: 2024-04-15T14:59:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.368 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.369 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.326+0000 7fcaf1ffb640 4 set_mon_vals no callback set 2024-04-15T14:59:55.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fcae4003c80 con 0x7fcaf40b57b0 2024-04-15T14:59:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1743157111 0 0) 0x7ff1e013d000 con 0x7ff1e00b57b0 2024-04-15T14:59:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 >> v1:172.21.15.164:6789/0 conn(0x7ff1e00b5b90 legacy=0x7ff1e0130b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 >> v1:172.21.15.38:6789/0 conn(0x7ff1e0146d70 legacy=0x7ff1e01312a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 1 monclient: found mon.c 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e013da00 con 0x7ff1e00b57b0 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1e569c640 5 monclient: authenticate success, global_id 54251 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1e569c640 10 monclient: _renew_subs 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1e569c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e013bce0 con 0x7ff1e00b57b0 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1e569c640 10 client.54251.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1e569c640 10 monclient: _renew_subs 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1e569c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1e01dd110 con 0x7ff1e00b57b0 2024-04-15T14:59:55.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7ff1e569c640 1 librados: init done 2024-04-15T14:59:55.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.327+0000 7fcaf2ffd640 10 monclient: get_auth_request con 0x7fcae006f220 auth_method 0 2024-04-15T14:59:55.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.328+0000 7fcadbfff640 10 client.4348.objecter ms_handle_connect 0x7fcae006f220 2024-04-15T14:59:55.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.328+0000 7ff1e569c640 10 client.54251.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.328+0000 7ff1e569c640 15 client.54251.objecter _session_command_op_assign -1 1 2024-04-15T14:59:55.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.328+0000 7ff1e569c640 20 client.54251.objecter _get_session osd=-1 returning homeless 2024-04-15T14:59:55.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.328+0000 7ff1e569c640 10 client.54251.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.328+0000 7ff1e569c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.328+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff1e00b6d60 con 0x7ff1e00b57b0 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fcae40534b0 con 0x7fcaf40b57b0 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 10 client.4348.objecter ms_dispatch 0x7fcaf4000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 3 client.4348.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 3 client.4348.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 10 client.4348.objecter checking command 1 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 20 client.4348.objecter _get_session s=0x7fcae0075c70 osd=2 3 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 20 client.4348.objecter put_session s=0x7fcae0075c70 osd=2 3 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 15 client.4348.objecter _session_command_op_remove -1 1 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 20 client.4348.objecter _get_session s=0x7fcae0075c70 osd=2 3 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 20 client.4348.objecter get_session s=0x7fcae0075c70 osd=2 3 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 15 client.4348.objecter _session_command_op_assign 2 1 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 20 client.4348.objecter put_session s=0x7fcae0075c70 osd=2 4 2024-04-15T14:59:55.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 10 client.4348.objecter _send_command 1 2024-04-15T14:59:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 --> v1:172.21.15.38:6801/2505059545 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcae0079ef0 con 0x7fcae0076320 2024-04-15T14:59:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 20 client.4348.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fcae40513c0 con 0x7fcaf40b57b0 2024-04-15T14:59:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcadbfff640 10 monclient: handle_get_version_reply finishing 1 version 28 2024-04-15T14:59:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.331+0000 7fcaf3fff640 10 monclient: get_auth_request con 0x7fcae0076320 auth_method 0 2024-04-15T14:59:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.333+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27c4077050 con 0x7f27c40b57d0 2024-04-15T14:59:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.333+0000 7f27b9ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.333+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f27c00037b0 con 0x7f27c40b57d0 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.333+0000 7f27b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.333+0000 7f27b9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.333+0000 7f27b9ffb640 10 monclient: dump: 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.333+0000 7f27bb7fe640 4 set_mon_vals no callback set 2024-04-15T14:59:55.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.334+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f27c0019ce0 con 0x7f27c40b57d0 2024-04-15T14:59:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.334+0000 7fcadbfff640 10 client.4348.objecter ms_handle_connect 0x7fcae0076320 2024-04-15T14:59:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.335+0000 7f27c8c86640 10 monclient: get_auth_request con 0x7f27a806ee10 auth_method 0 2024-04-15T14:59:55.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.335+0000 7f27b9ffb640 10 client.4362.objecter ms_handle_connect 0x7f27a806ee10 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.339+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0868003610 con 0x7f0870006890 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.339+0000 7f085f7fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.339+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0868003960 con 0x7f0870006890 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.339+0000 7f085f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.339+0000 7f085f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.339+0000 7f085f7fe640 10 monclient: dump: 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.379 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.339+0000 7f08757fa640 4 set_mon_vals no callback set 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.340+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f0868003b00 con 0x7f0870006890 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.340+0000 7f08767fc640 10 monclient: get_auth_request con 0x7f086406edf0 auth_method 0 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.340+0000 7f085f7fe640 10 client.4339.objecter ms_handle_connect 0x7f086406edf0 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f08680534e0 con 0x7f0870006890 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 10 client.4339.objecter ms_dispatch 0x7f0878000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 3 client.4339.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 3 client.4339.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 10 client.4339.objecter checking command 1 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 20 client.4339.objecter _get_session s=0x7f0864075860 osd=6 3 2024-04-15T14:59:55.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 20 client.4339.objecter put_session s=0x7f0864075860 osd=6 3 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 15 client.4339.objecter _session_command_op_remove -1 1 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 20 client.4339.objecter _get_session s=0x7f0864075860 osd=6 3 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 20 client.4339.objecter get_session s=0x7f0864075860 osd=6 3 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 15 client.4339.objecter _session_command_op_assign 6 1 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 20 client.4339.objecter put_session s=0x7f0864075860 osd=6 4 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 10 client.4339.objecter _send_command 1 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.164:6808/3078148286 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0864079ae0 con 0x7f0864075f10 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.341+0000 7f085f7fe640 20 client.4339.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f3f88052010 con 0x7f3f980b57b0 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 10 client.4356.objecter ms_dispatch 0x7f3f98000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 3 client.4356.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 3 client.4356.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 10 client.4356.objecter checking command 1 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 20 client.4356.objecter _get_session s=0x7f3f84075810 osd=7 3 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 20 client.4356.objecter put_session s=0x7f3f84075810 osd=7 3 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 15 client.4356.objecter _session_command_op_remove -1 1 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 20 client.4356.objecter _get_session s=0x7f3f84075810 osd=7 3 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 20 client.4356.objecter get_session s=0x7f3f84075810 osd=7 3 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 15 client.4356.objecter _session_command_op_assign 7 1 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 20 client.4356.objecter put_session s=0x7f3f84075810 osd=7 4 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 10 client.4356.objecter _send_command 1 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.164:6800/3353977755 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f84079a90 con 0x7f3f84075ec0 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 20 client.4356.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f3f8804fd50 con 0x7f3f980b57b0 2024-04-15T14:59:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f3f94ff9640 10 monclient: handle_get_version_reply finishing 1 version 28 2024-04-15T14:59:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f08777fe640 10 monclient: get_auth_request con 0x7f0864075f10 auth_method 0 2024-04-15T14:59:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f27c0052180 con 0x7f27c40b57d0 2024-04-15T14:59:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 10 client.4362.objecter ms_dispatch 0x7f27c4000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 3 client.4362.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 3 client.4362.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 10 client.4362.objecter checking command 1 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 20 client.4362.objecter _get_session s=0x7f27a80757f0 osd=3 3 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 20 client.4362.objecter put_session s=0x7f27a80757f0 osd=3 3 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 15 client.4362.objecter _session_command_op_remove -1 1 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 20 client.4362.objecter _get_session s=0x7f27a80757f0 osd=3 3 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 20 client.4362.objecter get_session s=0x7f27a80757f0 osd=3 3 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 15 client.4362.objecter _session_command_op_assign 3 1 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 20 client.4362.objecter put_session s=0x7f27a80757f0 osd=3 4 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 10 client.4362.objecter _send_command 1 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 --> v1:172.21.15.38:6813/2746933626 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27c001a530 con 0x7f27a8075ea0 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 20 client.4362.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f27c004fec0 con 0x7f27c40b57d0 2024-04-15T14:59:55.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.342+0000 7f27b9ffb640 10 monclient: handle_get_version_reply finishing 1 version 28 2024-04-15T14:59:55.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.343+0000 7f3f9cf08640 10 monclient: get_auth_request con 0x7f3f84075ec0 auth_method 0 2024-04-15T14:59:55.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.343+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f08680513f0 con 0x7f0870006890 2024-04-15T14:59:55.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.343+0000 7f085f7fe640 10 monclient: handle_get_version_reply finishing 1 version 28 2024-04-15T14:59:55.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.343+0000 7f27c9c88640 10 monclient: get_auth_request con 0x7f27a8075ea0 auth_method 0 2024-04-15T14:59:55.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.345+0000 7f085f7fe640 10 client.4339.objecter ms_handle_connect 0x7f0864075f10 2024-04-15T14:59:55.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.345+0000 7f3f94ff9640 10 client.4356.objecter ms_handle_connect 0x7f3f84075ec0 2024-04-15T14:59:55.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.346+0000 7f27b9ffb640 10 client.4362.objecter ms_handle_connect 0x7f27a8075ea0 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.349+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1e00b6d60 con 0x7ff1e00b57b0 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.349+0000 7ff1d77fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.349+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7ff1d0003790 con 0x7ff1e00b57b0 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.349+0000 7ff1d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.349+0000 7ff1d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.349+0000 7ff1d77fe640 10 monclient: dump: 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.388 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.349+0000 7ff1ddffb640 4 set_mon_vals no callback set 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.350+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7ff1d0003930 con 0x7ff1e00b57b0 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.351+0000 7ff1d7fff640 10 monclient: get_auth_request con 0x7ff1c006f000 auth_method 0 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.351+0000 7ff1d77fe640 10 client.54251.objecter ms_handle_connect 0x7ff1c006f000 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7ff1d00532a0 con 0x7ff1e00b57b0 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 10 client.54251.objecter ms_dispatch 0x7ff1e0000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 3 client.54251.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 3 client.54251.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 10 client.54251.objecter checking command 1 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 20 client.54251.objecter _get_session s=0x7ff1c0075a70 osd=1 3 2024-04-15T14:59:55.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 20 client.54251.objecter put_session s=0x7ff1c0075a70 osd=1 3 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 15 client.54251.objecter _session_command_op_remove -1 1 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 20 client.54251.objecter _get_session s=0x7ff1c0075a70 osd=1 3 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 20 client.54251.objecter get_session s=0x7ff1c0075a70 osd=1 3 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 15 client.54251.objecter _session_command_op_assign 1 1 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 20 client.54251.objecter put_session s=0x7ff1c0075a70 osd=1 4 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 10 client.54251.objecter _send_command 1 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6806/3103013511 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1c8000ed0 con 0x7ff1c0076120 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.354+0000 7ff1d77fe640 20 client.54251.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.355+0000 7ff1df7fe640 10 monclient: get_auth_request con 0x7ff1c0076120 auth_method 0 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.356+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7ff1d00511b0 con 0x7ff1e00b57b0 2024-04-15T14:59:55.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.356+0000 7ff1d77fe640 10 monclient: handle_get_version_reply finishing 1 version 28 2024-04-15T14:59:55.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.356+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== osd.4 v1:172.21.15.164:6812/1135451953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff3f80042b0 con 0x7ff3f4076120 2024-04-15T14:59:55.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.356+0000 7ff4057fa640 10 client.54242.objecter ms_dispatch 0x7ff408000b90 command_reply(tid 1: 0 ) 2024-04-15T14:59:55.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.356+0000 7ff4057fa640 10 client.54242.objecter _finish_command 1 = system:0 2024-04-15T14:59:55.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.356+0000 7ff4057fa640 20 client.54242.objecter put_session s=0x7ff3f4075a70 osd=4 4 2024-04-15T14:59:55.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.356+0000 7ff4057fa640 15 client.54242.objecter _session_command_op_remove 4 1 2024-04-15T14:59:55.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.357+0000 7ff1d77fe640 10 client.54251.objecter ms_handle_connect 0x7ff1c0076120 2024-04-15T14:59:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.369+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== osd.5 v1:172.21.15.164:6804/350713352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fc5e4079c20 con 0x7fc5e4076050 2024-04-15T14:59:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.369+0000 7fc5f6ffd640 10 client.4330.objecter ms_dispatch 0x7fc600000b90 command_reply(tid 1: 0 ) 2024-04-15T14:59:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.369+0000 7fc5f6ffd640 10 client.4330.objecter _finish_command 1 = system:0 2024-04-15T14:59:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.369+0000 7fc5f6ffd640 20 client.4330.objecter put_session s=0x7fc5e40759a0 osd=5 4 2024-04-15T14:59:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.369+0000 7fc5f6ffd640 15 client.4330.objecter _session_command_op_remove 5 1 2024-04-15T14:59:55.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.374+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== osd.0 v1:172.21.15.38:6805/3048929997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f2c6c079a90 con 0x7f2c6c075ec0 2024-04-15T14:59:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.374+0000 7f2c7e7fc640 10 client.54239.objecter ms_dispatch 0x7f2c88000b90 command_reply(tid 1: 0 ) 2024-04-15T14:59:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.374+0000 7f2c7e7fc640 10 client.54239.objecter _finish_command 1 = system:0 2024-04-15T14:59:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.374+0000 7f2c7e7fc640 20 client.54239.objecter put_session s=0x7f2c6c075810 osd=0 4 2024-04-15T14:59:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.374+0000 7f2c7e7fc640 15 client.54239.objecter _session_command_op_remove 0 1 2024-04-15T14:59:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 10 client.54242.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-15T14:59:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 15 client.54242.objecter _session_command_op_assign -1 2 2024-04-15T14:59:55.393 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 20 client.54242.objecter _get_session s=0x7ff3f4075a70 osd=4 3 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 20 client.54242.objecter put_session s=0x7ff3f4075a70 osd=4 3 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 20 client.54242.objecter _get_session s=0x7ff3f4075a70 osd=4 3 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 15 client.54242.objecter _session_command_op_remove -1 2 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 20 client.54242.objecter get_session s=0x7ff3f4075a70 osd=4 3 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 15 client.54242.objecter _session_command_op_assign 4 2 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 20 client.54242.objecter put_session s=0x7ff3f4075a70 osd=4 4 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 10 client.54242.objecter _send_command 2 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.382+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 --> v1:172.21.15.164:6812/1135451953 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff4000e6210 con 0x7ff3f4076120 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.389+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== osd.7 v1:172.21.15.164:6800/3353977755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f3f84079a90 con 0x7f3f84075ec0 2024-04-15T14:59:55.394 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.389+0000 7f3f94ff9640 10 client.4356.objecter ms_dispatch 0x7f3f98000b90 command_reply(tid 1: 0 ) 2024-04-15T14:59:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.389+0000 7f3f94ff9640 10 client.4356.objecter _finish_command 1 = system:0 2024-04-15T14:59:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.389+0000 7f3f94ff9640 20 client.4356.objecter put_session s=0x7f3f84075810 osd=7 4 2024-04-15T14:59:55.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.389+0000 7f3f94ff9640 15 client.4356.objecter _session_command_op_remove 7 1 2024-04-15T14:59:55.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.390+0000 7ff4057fa640 1 -- 172.21.15.38:0/434964162 <== osd.4 v1:172.21.15.164:6812/1135451953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 30394260) 0x7ff4000e6210 con 0x7ff3f4076120 2024-04-15T14:59:55.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.390+0000 7ff4057fa640 10 client.54242.objecter ms_dispatch 0x7ff408000b90 command_reply(tid 2: 0 ) 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.390+0000 7ff4057fa640 10 client.54242.objecter _finish_command 2 = system:0 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.390+0000 7ff4057fa640 20 client.54242.objecter put_session s=0x7ff3f4075a70 osd=4 4 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.390+0000 7ff4057fa640 15 client.54242.objecter _session_command_op_remove 4 2 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.391+0000 7ff40f08f640 10 librados: watch_flush enter 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.391+0000 7ff40f08f640 10 librados: watch_flush exit 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.391+0000 7ff40f08f640 10 client.54242.objecter close_session for osd.4 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.391+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 >> v1:172.21.15.164:6812/1135451953 conn(0x7ff3f4076120 legacy=0x7ff3f4078540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.391+0000 7ff40f08f640 20 client.54242.objecter put_session s=0x7ff3f4075a70 osd=4 1 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.391+0000 7ff40f08f640 20 client.54242.objecter shutdown clearing up homeless session... 2024-04-15T14:59:55.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.391+0000 7ff40f08f640 10 client.54242.objecter successfully canceled tick 2024-04-15T14:59:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.395+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== osd.6 v1:172.21.15.164:6808/3078148286 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f0864079ae0 con 0x7f0864075f10 2024-04-15T14:59:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.395+0000 7f085f7fe640 10 client.4339.objecter ms_dispatch 0x7f0878000b90 command_reply(tid 1: 0 ) 2024-04-15T14:59:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.395+0000 7f085f7fe640 10 client.4339.objecter _finish_command 1 = system:0 2024-04-15T14:59:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.395+0000 7f085f7fe640 20 client.4339.objecter put_session s=0x7f0864075860 osd=6 4 2024-04-15T14:59:55.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.395+0000 7f085f7fe640 15 client.4339.objecter _session_command_op_remove 6 1 2024-04-15T14:59:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.397+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 >> v1:172.21.15.38:6800/1608957829 conn(0x7ff3f406f000 legacy=0x7ff3f40714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.397+0000 7ff40f08f640 10 monclient: shutdown 2024-04-15T14:59:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.397+0000 7ff40f08f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.397+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 >> v1:172.21.15.38:6790/0 conn(0x7ff40002b0c0 legacy=0x7ff4000f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.397+0000 7ff40d62c640 1 -- 172.21.15.38:0/434964162 reap_dead start 2024-04-15T14:59:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.397+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 shutdown_connections 2024-04-15T14:59:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.397+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 >> 172.21.15.38:0/434964162 conn(0x7ff400005920 msgr2=0x7ff400005120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.397+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 shutdown_connections 2024-04-15T14:59:55.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.397+0000 7ff40f08f640 1 -- 172.21.15.38:0/434964162 wait complete. 2024-04-15T14:59:55.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.399+0000 7ff40f08f640 1 librados: shutdown 2024-04-15T14:59:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 10 client.4330.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-15T14:59:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 15 client.4330.objecter _session_command_op_assign -1 2 2024-04-15T14:59:55.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 20 client.4330.objecter _get_session s=0x7fc5e40759a0 osd=5 3 2024-04-15T14:59:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 20 client.4330.objecter put_session s=0x7fc5e40759a0 osd=5 3 2024-04-15T14:59:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 20 client.4330.objecter _get_session s=0x7fc5e40759a0 osd=5 3 2024-04-15T14:59:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 15 client.4330.objecter _session_command_op_remove -1 2 2024-04-15T14:59:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 20 client.4330.objecter get_session s=0x7fc5e40759a0 osd=5 3 2024-04-15T14:59:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 15 client.4330.objecter _session_command_op_assign 5 2 2024-04-15T14:59:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 20 client.4330.objecter put_session s=0x7fc5e40759a0 osd=5 4 2024-04-15T14:59:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 10 client.4330.objecter _send_command 2 2024-04-15T14:59:55.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.400+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 --> v1:172.21.15.164:6804/350713352 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5f8005120 con 0x7fc5e4076050 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 10 client.54239.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 15 client.54239.objecter _session_command_op_assign -1 2 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 20 client.54239.objecter _get_session s=0x7f2c6c075810 osd=0 3 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 20 client.54239.objecter put_session s=0x7f2c6c075810 osd=0 3 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 20 client.54239.objecter _get_session s=0x7f2c6c075810 osd=0 3 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 15 client.54239.objecter _session_command_op_remove -1 2 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 20 client.54239.objecter get_session s=0x7f2c6c075810 osd=0 3 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 15 client.54239.objecter _session_command_op_assign 0 2 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 20 client.54239.objecter put_session s=0x7f2c6c075810 osd=0 4 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 10 client.54239.objecter _send_command 2 2024-04-15T14:59:55.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.406+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 --> v1:172.21.15.38:6805/3048929997 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2c8002a520 con 0x7f2c6c075ec0 2024-04-15T14:59:55.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.409+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== osd.1 v1:172.21.15.38:6806/3103013511 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff1c8000ed0 con 0x7ff1c0076120 2024-04-15T14:59:55.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.409+0000 7ff1d77fe640 10 client.54251.objecter ms_dispatch 0x7ff1e0000b90 command_reply(tid 1: 0 ) 2024-04-15T14:59:55.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.409+0000 7ff1d77fe640 10 client.54251.objecter _finish_command 1 = system:0 2024-04-15T14:59:55.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.409+0000 7ff1d77fe640 20 client.54251.objecter put_session s=0x7ff1c0075a70 osd=1 4 2024-04-15T14:59:55.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.409+0000 7ff1d77fe640 15 client.54251.objecter _session_command_op_remove 1 1 2024-04-15T14:59:55.414 INFO:teuthology.orchestra.run.smithi038.stdout:85899345927 2024-04-15T14:59:55.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-15T14:59:55.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.413+0000 7fc5f6ffd640 1 -- 172.21.15.38:0/1823909852 <== osd.5 v1:172.21.15.164:6804/350713352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3102909477) 0x7fc5f8005120 con 0x7fc5e4076050 2024-04-15T14:59:55.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.413+0000 7fc5f6ffd640 10 client.4330.objecter ms_dispatch 0x7fc600000b90 command_reply(tid 2: 0 ) 2024-04-15T14:59:55.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.413+0000 7fc5f6ffd640 10 client.4330.objecter _finish_command 2 = system:0 2024-04-15T14:59:55.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.413+0000 7fc5f6ffd640 20 client.4330.objecter put_session s=0x7fc5e40759a0 osd=5 4 2024-04-15T14:59:55.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.413+0000 7fc5f6ffd640 15 client.4330.objecter _session_command_op_remove 5 2 2024-04-15T14:59:55.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 10 librados: watch_flush enter 2024-04-15T14:59:55.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 10 librados: watch_flush exit 2024-04-15T14:59:55.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 10 client.4330.objecter close_session for osd.5 2024-04-15T14:59:55.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 >> v1:172.21.15.164:6804/350713352 conn(0x7fc5e4076050 legacy=0x7fc5e4078470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 20 client.4330.objecter put_session s=0x7fc5e40759a0 osd=5 1 2024-04-15T14:59:55.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 20 client.4330.objecter shutdown clearing up homeless session... 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 10 client.4330.objecter successfully canceled tick 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 >> v1:172.21.15.38:6800/1608957829 conn(0x7fc5e406ef50 legacy=0x7fc5e4071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 10 monclient: shutdown 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 >> v1:172.21.15.164:6789/0 conn(0x7fc5f80c61d0 legacy=0x7fc5f8160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc606d2a640 1 -- 172.21.15.38:0/1823909852 reap_dead start 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 shutdown_connections 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.414+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 >> 172.21.15.38:0/1823909852 conn(0x7fc5f8005c00 msgr2=0x7fc5f8005fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.415+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 shutdown_connections 2024-04-15T14:59:55.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.415+0000 7fc60878d640 1 -- 172.21.15.38:0/1823909852 wait complete. 2024-04-15T14:59:55.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.415+0000 7fc60878d640 1 librados: shutdown 2024-04-15T14:59:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 10 client.4339.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-15T14:59:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 15 client.4339.objecter _session_command_op_assign -1 2 2024-04-15T14:59:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 20 client.4339.objecter _get_session s=0x7f0864075860 osd=6 3 2024-04-15T14:59:55.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 20 client.4339.objecter put_session s=0x7f0864075860 osd=6 3 2024-04-15T14:59:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 20 client.4339.objecter _get_session s=0x7f0864075860 osd=6 3 2024-04-15T14:59:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 15 client.4339.objecter _session_command_op_remove -1 2 2024-04-15T14:59:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 20 client.4339.objecter get_session s=0x7f0864075860 osd=6 3 2024-04-15T14:59:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 15 client.4339.objecter _session_command_op_assign 6 2 2024-04-15T14:59:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 20 client.4339.objecter put_session s=0x7f0864075860 osd=6 4 2024-04-15T14:59:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 10 client.4339.objecter _send_command 2 2024-04-15T14:59:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.424+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 --> v1:172.21.15.164:6808/3078148286 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0870004cd0 con 0x7f0864075f10 2024-04-15T14:59:55.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f2c7e7fc640 1 -- 172.21.15.38:0/1696221308 <== osd.0 v1:172.21.15.38:6805/3048929997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1521392682) 0x7f2c8002a520 con 0x7f2c6c075ec0 2024-04-15T14:59:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f2c7e7fc640 10 client.54239.objecter ms_dispatch 0x7f2c88000b90 command_reply(tid 2: 0 ) 2024-04-15T14:59:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f2c7e7fc640 10 client.54239.objecter _finish_command 2 = system:0 2024-04-15T14:59:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 10 client.4356.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-15T14:59:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 15 client.4356.objecter _session_command_op_assign -1 2 2024-04-15T14:59:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 20 client.4356.objecter _get_session s=0x7f3f84075810 osd=7 3 2024-04-15T14:59:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 20 client.4356.objecter put_session s=0x7f3f84075810 osd=7 3 2024-04-15T14:59:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 20 client.4356.objecter _get_session s=0x7f3f84075810 osd=7 3 2024-04-15T14:59:55.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 15 client.4356.objecter _session_command_op_remove -1 2 2024-04-15T14:59:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f2c7e7fc640 20 client.54239.objecter put_session s=0x7f2c6c075810 osd=0 4 2024-04-15T14:59:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f2c7e7fc640 15 client.54239.objecter _session_command_op_remove 0 2 2024-04-15T14:59:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 20 client.4356.objecter get_session s=0x7f3f84075810 osd=7 3 2024-04-15T14:59:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 15 client.4356.objecter _session_command_op_assign 7 2 2024-04-15T14:59:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 20 client.4356.objecter put_session s=0x7f3f84075810 osd=7 4 2024-04-15T14:59:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 10 client.4356.objecter _send_command 2 2024-04-15T14:59:55.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.425+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 --> v1:172.21.15.164:6800/3353977755 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3f98150120 con 0x7f3f84075ec0 2024-04-15T14:59:55.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 10 librados: watch_flush enter 2024-04-15T14:59:55.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 10 librados: watch_flush exit 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 10 client.54239.objecter close_session for osd.0 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 >> v1:172.21.15.38:6805/3048929997 conn(0x7f2c6c075ec0 legacy=0x7f2c6c0782e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 20 client.54239.objecter put_session s=0x7f2c6c075810 osd=0 1 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 20 client.54239.objecter shutdown clearing up homeless session... 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 10 client.54239.objecter successfully canceled tick 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 >> v1:172.21.15.38:6800/1608957829 conn(0x7f2c6c06eda0 legacy=0x7f2c6c071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 10 monclient: shutdown 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 >> v1:172.21.15.38:6790/0 conn(0x7f2c80006890 legacy=0x7f2c80161270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.426+0000 7f2c8e216640 1 -- 172.21.15.38:0/1696221308 reap_dead start 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.427+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 shutdown_connections 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.427+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 >> 172.21.15.38:0/1696221308 conn(0x7f2c800058f0 msgr2=0x7f2c80005cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.427+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 shutdown_connections 2024-04-15T14:59:55.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.428+0000 7f2c8ea17640 1 -- 172.21.15.38:0/1696221308 wait complete. 2024-04-15T14:59:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.428+0000 7f2c8ea17640 1 librados: shutdown 2024-04-15T14:59:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.430+0000 7f085f7fe640 1 -- 172.21.15.38:0/3787861406 <== osd.6 v1:172.21.15.164:6808/3078148286 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3998931041) 0x7f0870004cd0 con 0x7f0864075f10 2024-04-15T14:59:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.430+0000 7f085f7fe640 10 client.4339.objecter ms_dispatch 0x7f0878000b90 command_reply(tid 2: 0 ) 2024-04-15T14:59:55.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.430+0000 7f085f7fe640 10 client.4339.objecter _finish_command 2 = system:0 2024-04-15T14:59:55.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.430+0000 7f085f7fe640 20 client.4339.objecter put_session s=0x7f0864075860 osd=6 4 2024-04-15T14:59:55.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.430+0000 7f085f7fe640 15 client.4339.objecter _session_command_op_remove 6 2 2024-04-15T14:59:55.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f087d4a1640 10 librados: watch_flush enter 2024-04-15T14:59:55.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f087d4a1640 10 librados: watch_flush exit 2024-04-15T14:59:55.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f087d4a1640 10 client.4339.objecter close_session for osd.6 2024-04-15T14:59:55.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 >> v1:172.21.15.164:6808/3078148286 conn(0x7f0864075f10 legacy=0x7f0864078330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f087d4a1640 20 client.4339.objecter put_session s=0x7f0864075860 osd=6 1 2024-04-15T14:59:55.434 INFO:teuthology.orchestra.run.smithi038.stdout:90194313223 2024-04-15T14:59:55.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f087d4a1640 20 client.4339.objecter shutdown clearing up homeless session... 2024-04-15T14:59:55.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f087d4a1640 10 client.4339.objecter successfully canceled tick 2024-04-15T14:59:55.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-15T14:59:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== osd.2 v1:172.21.15.38:6801/2505059545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fcae0079ef0 con 0x7fcae0076320 2024-04-15T14:59:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7fcadbfff640 10 client.4348.objecter ms_dispatch 0x7fcaf4000b90 command_reply(tid 1: 0 ) 2024-04-15T14:59:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7fcadbfff640 10 client.4348.objecter _finish_command 1 = system:0 2024-04-15T14:59:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7fcadbfff640 20 client.4348.objecter put_session s=0x7fcae0075c70 osd=2 4 2024-04-15T14:59:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7fcadbfff640 15 client.4348.objecter _session_command_op_remove 2 1 2024-04-15T14:59:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f3f94ff9640 1 -- 172.21.15.38:0/137848201 <== osd.7 v1:172.21.15.164:6800/3353977755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2365829177) 0x7f3f98150120 con 0x7f3f84075ec0 2024-04-15T14:59:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f3f94ff9640 10 client.4356.objecter ms_dispatch 0x7f3f98000b90 command_reply(tid 2: 0 ) 2024-04-15T14:59:55.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f3f94ff9640 10 client.4356.objecter _finish_command 2 = system:0 2024-04-15T14:59:55.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f3f94ff9640 20 client.4356.objecter put_session s=0x7f3f84075810 osd=7 4 2024-04-15T14:59:55.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f3f94ff9640 15 client.4356.objecter _session_command_op_remove 7 2 2024-04-15T14:59:55.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.431+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 >> v1:172.21.15.38:6800/1608957829 conn(0x7f086406edf0 legacy=0x7f08640712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f087d4a1640 10 monclient: shutdown 2024-04-15T14:59:55.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f087d4a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 >> v1:172.21.15.164:6789/0 conn(0x7f0870006890 legacy=0x7f0870159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f08777fe640 1 -- 172.21.15.38:0/3787861406 reap_dead start 2024-04-15T14:59:55.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 shutdown_connections 2024-04-15T14:59:55.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 >> 172.21.15.38:0/3787861406 conn(0x7f08700058f0 msgr2=0x7f0870038130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 shutdown_connections 2024-04-15T14:59:55.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 10 librados: watch_flush enter 2024-04-15T14:59:55.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 10 librados: watch_flush exit 2024-04-15T14:59:55.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 10 client.4356.objecter close_session for osd.7 2024-04-15T14:59:55.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 >> v1:172.21.15.164:6800/3353977755 conn(0x7f3f84075ec0 legacy=0x7f3f840782e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 20 client.4356.objecter put_session s=0x7f3f84075810 osd=7 1 2024-04-15T14:59:55.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 20 client.4356.objecter shutdown clearing up homeless session... 2024-04-15T14:59:55.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 10 client.4356.objecter successfully canceled tick 2024-04-15T14:59:55.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f087d4a1640 1 -- 172.21.15.38:0/3787861406 wait complete. 2024-04-15T14:59:55.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.433+0000 7f087d4a1640 1 librados: shutdown 2024-04-15T14:59:55.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 >> v1:172.21.15.38:6800/1608957829 conn(0x7f3f8406ee30 legacy=0x7f3f840712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 10 monclient: shutdown 2024-04-15T14:59:55.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 >> v1:172.21.15.38:6789/0 conn(0x7f3f980b57b0 legacy=0x7f3f980b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9cf08640 1 -- 172.21.15.38:0/137848201 reap_dead start 2024-04-15T14:59:55.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 shutdown_connections 2024-04-15T14:59:55.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.432+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 >> 172.21.15.38:0/137848201 conn(0x7f3f98067790 msgr2=0x7f3f980b75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.433+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 shutdown_connections 2024-04-15T14:59:55.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.433+0000 7f3f9e96b640 1 -- 172.21.15.38:0/137848201 wait complete. 2024-04-15T14:59:55.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.433+0000 7f3f9e96b640 1 librados: shutdown 2024-04-15T14:59:55.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 10 client.54251.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 15 client.54251.objecter _session_command_op_assign -1 2 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 20 client.54251.objecter _get_session s=0x7ff1c0075a70 osd=1 3 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 20 client.54251.objecter put_session s=0x7ff1c0075a70 osd=1 3 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 20 client.54251.objecter _get_session s=0x7ff1c0075a70 osd=1 3 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 15 client.54251.objecter _session_command_op_remove -1 2 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 20 client.54251.objecter get_session s=0x7ff1c0075a70 osd=1 3 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 15 client.54251.objecter _session_command_op_assign 1 2 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 20 client.54251.objecter put_session s=0x7ff1c0075a70 osd=1 4 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 10 client.54251.objecter _send_command 2 2024-04-15T14:59:55.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.437+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 --> v1:172.21.15.38:6806/3103013511 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1e0077050 con 0x7ff1c0076120 2024-04-15T14:59:55.445 INFO:teuthology.orchestra.run.smithi038.stdout:68719476742 2024-04-15T14:59:55.445 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T14:59:55.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1d77fe640 1 -- 172.21.15.38:0/2042630551 <== osd.1 v1:172.21.15.38:6806/3103013511 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1521392682) 0x7ff1e0077050 con 0x7ff1c0076120 2024-04-15T14:59:55.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1d77fe640 10 client.54251.objecter ms_dispatch 0x7ff1e0000b90 command_reply(tid 2: 0 ) 2024-04-15T14:59:55.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1d77fe640 10 client.54251.objecter _finish_command 2 = system:0 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1d77fe640 20 client.54251.objecter put_session s=0x7ff1c0075a70 osd=1 4 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1d77fe640 15 client.54251.objecter _session_command_op_remove 1 2 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 10 librados: watch_flush enter 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 10 librados: watch_flush exit 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 10 client.54251.objecter close_session for osd.1 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 >> v1:172.21.15.38:6806/3103013511 conn(0x7ff1c0076120 legacy=0x7ff1c0078540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 20 client.54251.objecter put_session s=0x7ff1c0075a70 osd=1 1 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 20 client.54251.objecter shutdown clearing up homeless session... 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 10 client.54251.objecter successfully canceled tick 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 >> v1:172.21.15.38:6800/1608957829 conn(0x7ff1c006f000 legacy=0x7ff1c00714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 10 monclient: shutdown 2024-04-15T14:59:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 >> v1:172.21.15.38:6790/0 conn(0x7ff1e00b57b0 legacy=0x7ff1e01dc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.446+0000 7ff1df7fe640 1 -- 172.21.15.38:0/2042630551 reap_dead start 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.447+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 shutdown_connections 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.447+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 >> 172.21.15.38:0/2042630551 conn(0x7ff1e0067790 msgr2=0x7ff1e00b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.449+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 shutdown_connections 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.449+0000 7ff1e569c640 1 -- 172.21.15.38:0/2042630551 wait complete. 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.449+0000 7ff1e569c640 1 librados: shutdown 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.449+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== osd.3 v1:172.21.15.38:6813/2746933626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f27c001a530 con 0x7f27a8075ea0 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.449+0000 7f27b9ffb640 10 client.4362.objecter ms_dispatch 0x7f27c4000b90 command_reply(tid 1: 0 ) 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.449+0000 7f27b9ffb640 10 client.4362.objecter _finish_command 1 = system:0 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.449+0000 7f27b9ffb640 20 client.4362.objecter put_session s=0x7f27a80757f0 osd=3 4 2024-04-15T14:59:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.449+0000 7f27b9ffb640 15 client.4362.objecter _session_command_op_remove 3 1 2024-04-15T14:59:55.454 INFO:teuthology.orchestra.run.smithi038.stdout:55834574856 2024-04-15T14:59:55.454 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-15T14:59:55.458 INFO:teuthology.orchestra.run.smithi038.stdout:90194313226 2024-04-15T14:59:55.458 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 10 client.4348.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 15 client.4348.objecter _session_command_op_assign -1 2 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 20 client.4348.objecter _get_session s=0x7fcae0075c70 osd=2 3 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 20 client.4348.objecter put_session s=0x7fcae0075c70 osd=2 3 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 20 client.4348.objecter _get_session s=0x7fcae0075c70 osd=2 3 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 15 client.4348.objecter _session_command_op_remove -1 2 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 20 client.4348.objecter get_session s=0x7fcae0075c70 osd=2 3 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 15 client.4348.objecter _session_command_op_assign 2 2 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 20 client.4348.objecter put_session s=0x7fcae0075c70 osd=2 4 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 10 client.4348.objecter _send_command 2 2024-04-15T14:59:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.460+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 --> v1:172.21.15.38:6801/2505059545 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcaf4077050 con 0x7fcae0076320 2024-04-15T14:59:55.468 INFO:teuthology.orchestra.run.smithi038.stdout:68719476742 2024-04-15T14:59:55.469 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 10 client.4362.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 15 client.4362.objecter _session_command_op_assign -1 2 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 20 client.4362.objecter _get_session s=0x7f27a80757f0 osd=3 3 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 20 client.4362.objecter put_session s=0x7f27a80757f0 osd=3 3 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 20 client.4362.objecter _get_session s=0x7f27a80757f0 osd=3 3 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 15 client.4362.objecter _session_command_op_remove -1 2 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 20 client.4362.objecter get_session s=0x7f27a80757f0 osd=3 3 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 15 client.4362.objecter _session_command_op_assign 3 2 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 20 client.4362.objecter put_session s=0x7f27a80757f0 osd=3 4 2024-04-15T14:59:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 10 client.4362.objecter _send_command 2 2024-04-15T14:59:55.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.475+0000 7f27af7fe640 1 -- 172.21.15.38:0/857966699 --> v1:172.21.15.38:6813/2746933626 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27c4141300 con 0x7f27a8075ea0 2024-04-15T14:59:55.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.484+0000 7fcadbfff640 1 -- 172.21.15.38:0/4112359770 <== osd.2 v1:172.21.15.38:6801/2505059545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 1087986762) 0x7fcaf4077050 con 0x7fcae0076320 2024-04-15T14:59:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.484+0000 7fcadbfff640 10 client.4348.objecter ms_dispatch 0x7fcaf4000b90 command_reply(tid 2: 0 ) 2024-04-15T14:59:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.484+0000 7fcadbfff640 10 client.4348.objecter _finish_command 2 = system:0 2024-04-15T14:59:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.484+0000 7fcadbfff640 20 client.4348.objecter put_session s=0x7fcae0075c70 osd=2 4 2024-04-15T14:59:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.484+0000 7fcadbfff640 15 client.4348.objecter _session_command_op_remove 2 2 2024-04-15T14:59:55.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.485+0000 7fcaf9b8e640 10 librados: watch_flush enter 2024-04-15T14:59:55.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.485+0000 7fcaf9b8e640 10 librados: watch_flush exit 2024-04-15T14:59:55.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.485+0000 7fcaf9b8e640 10 client.4348.objecter close_session for osd.2 2024-04-15T14:59:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.485+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 >> v1:172.21.15.38:6801/2505059545 conn(0x7fcae0076320 legacy=0x7fcae0078740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.485+0000 7fcaf9b8e640 20 client.4348.objecter put_session s=0x7fcae0075c70 osd=2 1 2024-04-15T14:59:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.485+0000 7fcaf9b8e640 20 client.4348.objecter shutdown clearing up homeless session... 2024-04-15T14:59:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.485+0000 7fcaf9b8e640 10 client.4348.objecter successfully canceled tick 2024-04-15T14:59:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.485+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 >> v1:172.21.15.38:6800/1608957829 conn(0x7fcae006f220 legacy=0x7fcae00716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.486+0000 7fcaf9b8e640 10 monclient: shutdown 2024-04-15T14:59:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.486+0000 7fcaf9b8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.486+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 >> v1:172.21.15.164:6789/0 conn(0x7fcaf40b57b0 legacy=0x7fcaf41d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.486+0000 7fcaf3fff640 1 -- 172.21.15.38:0/4112359770 reap_dead start 2024-04-15T14:59:55.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.487+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 shutdown_connections 2024-04-15T14:59:55.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.487+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 >> 172.21.15.38:0/4112359770 conn(0x7fcaf4067790 msgr2=0x7fcaf4146370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.488+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 shutdown_connections 2024-04-15T14:59:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.488+0000 7fcaf9b8e640 1 -- 172.21.15.38:0/4112359770 wait complete. 2024-04-15T14:59:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.488+0000 7fcaf9b8e640 1 librados: shutdown 2024-04-15T14:59:55.509 INFO:teuthology.orchestra.run.smithi038.stdout:103079215112 2024-04-15T14:59:55.510 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T14:59:55.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.531+0000 7f27b9ffb640 1 -- 172.21.15.38:0/857966699 <== osd.3 v1:172.21.15.38:6813/2746933626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3190059493) 0x7f27c4141300 con 0x7f27a8075ea0 2024-04-15T14:59:55.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.531+0000 7f27b9ffb640 10 client.4362.objecter ms_dispatch 0x7f27c4000b90 command_reply(tid 2: 0 ) 2024-04-15T14:59:55.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.531+0000 7f27b9ffb640 10 client.4362.objecter _finish_command 2 = system:0 2024-04-15T14:59:55.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.531+0000 7f27b9ffb640 20 client.4362.objecter put_session s=0x7f27a80757f0 osd=3 4 2024-04-15T14:59:55.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.531+0000 7f27b9ffb640 15 client.4362.objecter _session_command_op_remove 3 2 2024-04-15T14:59:55.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.531+0000 7f27cb6eb640 10 librados: watch_flush enter 2024-04-15T14:59:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 10 librados: watch_flush exit 2024-04-15T14:59:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 10 client.4362.objecter close_session for osd.3 2024-04-15T14:59:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 1 -- 172.21.15.38:0/857966699 >> v1:172.21.15.38:6813/2746933626 conn(0x7f27a8075ea0 legacy=0x7f27a80782c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 20 client.4362.objecter put_session s=0x7f27a80757f0 osd=3 1 2024-04-15T14:59:55.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 20 client.4362.objecter shutdown clearing up homeless session... 2024-04-15T14:59:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 10 client.4362.objecter successfully canceled tick 2024-04-15T14:59:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 1 -- 172.21.15.38:0/857966699 >> v1:172.21.15.38:6800/1608957829 conn(0x7f27a806ee10 legacy=0x7f27a80712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 10 monclient: shutdown 2024-04-15T14:59:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27cb6eb640 1 -- 172.21.15.38:0/857966699 >> v1:172.21.15.38:6789/0 conn(0x7f27c40b57d0 legacy=0x7f27c40acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.532+0000 7f27c9c88640 1 -- 172.21.15.38:0/857966699 reap_dead start 2024-04-15T14:59:55.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.533+0000 7f27cb6eb640 1 -- 172.21.15.38:0/857966699 shutdown_connections 2024-04-15T14:59:55.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.533+0000 7f27cb6eb640 1 -- 172.21.15.38:0/857966699 >> 172.21.15.38:0/857966699 conn(0x7f27c4067790 msgr2=0x7f27c4067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.533+0000 7f27cb6eb640 1 -- 172.21.15.38:0/857966699 shutdown_connections 2024-04-15T14:59:55.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.533+0000 7f27cb6eb640 1 -- 172.21.15.38:0/857966699 wait complete. 2024-04-15T14:59:55.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.533+0000 7f27cb6eb640 1 librados: shutdown 2024-04-15T14:59:55.555 INFO:teuthology.orchestra.run.smithi038.stdout:98784247816 2024-04-15T14:59:55.556 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-15T14:59:55.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.584+0000 7febf040d640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.584+0000 7febf040d640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.584+0000 7febf040d640 10 monclient: monmap: 2024-04-15T14:59:55.588 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.588 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.588 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.586001+0000 2024-04-15T14:59:55.588 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.586001+0000 2024-04-15T14:59:55.588 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.589 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.589 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.589 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.589 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.589 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.585+0000 7febf040d640 1 Processor -- start 2024-04-15T14:59:55.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.585+0000 7febf040d640 1 -- start start 2024-04-15T14:59:55.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.585+0000 7febf040d640 10 monclient: init 2024-04-15T14:59:55.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:55.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 10 monclient(hunting): picked mon.noname-b con 0x7febe80b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 10 monclient(hunting): picked mon.noname-a con 0x7febe80b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 10 monclient(hunting): picked mon.noname-c con 0x7febe8146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe8140ca0 con 0x7febe80b5b90 2024-04-15T14:59:55.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe80ab0e0 con 0x7febe8146d70 2024-04-15T14:59:55.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe80b3310 con 0x7febe80b57b0 2024-04-15T14:59:55.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.586+0000 7febf040d640 10 monclient(hunting): authenticate will time out at 1455.858058s 2024-04-15T14:59:55.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.587+0000 7febee1a9640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7febe80b57b0 0x7febe8140590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45830/0 (socket says 172.21.15.38:45830) 2024-04-15T14:59:55.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.587+0000 7febee1a9640 1 -- 172.21.15.38:0/4234590332 learned_addr learned my addr 172.21.15.38:0/4234590332 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.593+0000 7febed1a7640 1 -- 172.21.15.38:0/4234590332 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962247148 0 0) 0x7febe80b3310 con 0x7febe80b57b0 2024-04-15T14:59:55.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.593+0000 7febed1a7640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.593+0000 7febed1a7640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.593+0000 7febed1a7640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.593+0000 7febed1a7640 10 monclient(hunting): my global_id is 54263 2024-04-15T14:59:55.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.593+0000 7febed1a7640 1 -- 172.21.15.38:0/4234590332 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febd4003520 con 0x7febe80b57b0 2024-04-15T14:59:55.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 1 -- 172.21.15.38:0/4234590332 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3559113075 0 0) 0x7febd4003520 con 0x7febe80b57b0 2024-04-15T14:59:55.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 1 -- 172.21.15.38:0/4234590332 >> v1:172.21.15.164:6789/0 conn(0x7febe8146d70 legacy=0x7febe814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:55.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 1 -- 172.21.15.38:0/4234590332 >> v1:172.21.15.38:6789/0 conn(0x7febe80b5b90 legacy=0x7febe8146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:55.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 1 monclient: found mon.noname-b 2024-04-15T14:59:55.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 1 -- 172.21.15.38:0/4234590332 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe80aa460 con 0x7febe80b57b0 2024-04-15T14:59:55.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 1 -- 172.21.15.38:0/4234590332 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7febe4001610 con 0x7febe80b57b0 2024-04-15T14:59:55.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.600+0000 7febed1a7640 10 monclient: dump: 2024-04-15T14:59:55.608 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.608 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.608 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.608 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.608 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.609 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.609 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.609 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.609 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.609 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.601+0000 7febf040d640 5 monclient: authenticate success, global_id 54263 2024-04-15T14:59:55.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.601+0000 7febf040d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.604+0000 7febed1a7640 1 -- 172.21.15.38:0/4234590332 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7febe4001870 con 0x7febe80b57b0 2024-04-15T14:59:55.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.604+0000 7febed1a7640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.604+0000 7febed1a7640 1 -- 172.21.15.38:0/4234590332 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7febe4001cc0 con 0x7febe80b57b0 2024-04-15T14:59:55.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.604+0000 7febed1a7640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.604+0000 7febed1a7640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.604+0000 7febed1a7640 10 monclient: dump: 2024-04-15T14:59:55.620 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.620 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.620 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.620 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.620 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.621 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.621 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.621 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.621 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.621 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.605+0000 7febf040d640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.605+0000 7febf040d640 4 set_mon_vals no callback set 2024-04-15T14:59:55.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.605+0000 7febf040d640 10 monclient: shutdown 2024-04-15T14:59:55.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.605+0000 7febf040d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.605+0000 7febf040d640 1 -- 172.21.15.38:0/4234590332 >> v1:172.21.15.38:6790/0 conn(0x7febe80b57b0 legacy=0x7febe8140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.607+0000 7febf040d640 1 -- 172.21.15.38:0/4234590332 shutdown_connections 2024-04-15T14:59:55.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.607+0000 7febf040d640 1 -- 172.21.15.38:0/4234590332 >> 172.21.15.38:0/4234590332 conn(0x7febe8067790 msgr2=0x7febe8067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.608+0000 7febf040d640 1 -- 172.21.15.38:0/4234590332 shutdown_connections 2024-04-15T14:59:55.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.608+0000 7febf040d640 1 -- 172.21.15.38:0/4234590332 wait complete. 2024-04-15T14:59:55.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.609+0000 7febf040d640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.609+0000 7febf040d640 10 monclient: monmap: 2024-04-15T14:59:55.624 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.624 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.624 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.624 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.625 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.625 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.610+0000 7febf040d640 1 librados: starting msgr at 2024-04-15T14:59:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.610+0000 7febf040d640 1 librados: starting objecter 2024-04-15T14:59:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.610+0000 7febf040d640 1 Processor -- start 2024-04-15T14:59:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.610+0000 7febf040d640 1 -- start start 2024-04-15T14:59:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.610+0000 7febf040d640 1 librados: setting wanted keys 2024-04-15T14:59:55.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.610+0000 7febf040d640 1 librados: calling monclient init 2024-04-15T14:59:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.610+0000 7febf040d640 10 monclient: init 2024-04-15T14:59:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.611+0000 7febf040d640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.611+0000 7febf040d640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.613+0000 7febee1a9640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7febe80b57b0 0x7febe81e2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45838/0 (socket says 172.21.15.38:45838) 2024-04-15T14:59:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.613+0000 7febee1a9640 1 -- 172.21.15.38:0/182853014 learned_addr learned my addr 172.21.15.38:0/182853014 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.614+0000 7febf040d640 10 monclient(hunting): picked mon.noname-c con 0x7febe80b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.615+0000 7febf040d640 10 monclient(hunting): picked mon.noname-a con 0x7febe80b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.615+0000 7febf040d640 10 monclient(hunting): picked mon.noname-b con 0x7febe8146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.615+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe806f760 con 0x7febe80b5b90 2024-04-15T14:59:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.615+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe806e8b0 con 0x7febe8146d70 2024-04-15T14:59:55.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.616+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe81e2780 con 0x7febe80b57b0 2024-04-15T14:59:55.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.618+0000 7f143bfff640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.618+0000 7f143bfff640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.618+0000 7f143bfff640 10 monclient: monmap: 2024-04-15T14:59:55.629 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.630 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.630 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.620034+0000 2024-04-15T14:59:55.630 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.620034+0000 2024-04-15T14:59:55.630 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.630 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.630 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.631 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.631 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.631 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.619+0000 7febf040d640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.619+0000 7febf040d640 10 monclient(hunting): authenticate will time out at 1455.891217s 2024-04-15T14:59:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.619+0000 7febdeffd640 10 client.?.objecter ms_handle_connect 0x7febe80b57b0 2024-04-15T14:59:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 10 client.?.objecter ms_handle_connect 0x7febe80b5b90 2024-04-15T14:59:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 10 client.?.objecter ms_handle_connect 0x7febe8146d70 2024-04-15T14:59:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7f143bfff640 1 Processor -- start 2024-04-15T14:59:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.619+0000 7f9b49ae4640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.619+0000 7f9b49ae4640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.619+0000 7f9b49ae4640 10 monclient: monmap: 2024-04-15T14:59:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.621512+0000 2024-04-15T14:59:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.621512+0000 2024-04-15T14:59:55.635 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.636 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.636 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7f143bfff640 1 -- start start 2024-04-15T14:59:55.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7f143bfff640 10 monclient: init 2024-04-15T14:59:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191993200 0 0) 0x7febe81e2780 con 0x7febe80b57b0 2024-04-15T14:59:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 10 monclient(hunting): my global_id is 54266 2024-04-15T14:59:55.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.620+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febcc004eb0 con 0x7febe80b57b0 2024-04-15T14:59:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.621+0000 7f143bfff640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.621+0000 7f143bfff640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.621+0000 7f143bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f14340389e0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.621+0000 7f143bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f1434038dc0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.621+0000 7f143bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f1434030660 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.621+0000 7f143bfff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1434036430 con 0x7f1434038dc0 2024-04-15T14:59:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.621+0000 7f143bfff640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1434039840 con 0x7f14340389e0 2024-04-15T14:59:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7f143bfff640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1434035690 con 0x7f1434030660 2024-04-15T14:59:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7f143bfff640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7f143bfff640 10 monclient(hunting): authenticate will time out at 1455.893480s 2024-04-15T14:59:55.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7f9b49ae4640 1 Processor -- start 2024-04-15T14:59:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7f143affd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f14340389e0 0x7f1434033520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:36932/0 (socket says 172.21.15.38:36932) 2024-04-15T14:59:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7f143affd640 1 -- 172.21.15.38:0/906460509 learned_addr learned my addr 172.21.15.38:0/906460509 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7f9b49ae4640 1 -- start start 2024-04-15T14:59:55.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7f9b49ae4640 10 monclient: init 2024-04-15T14:59:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1369969107 0 0) 0x7febe806f760 con 0x7febe80b5b90 2024-04-15T14:59:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 10 monclient(hunting): my global_id is 4365 2024-04-15T14:59:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febe81e2780 con 0x7febe80b5b90 2024-04-15T14:59:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839968858 0 0) 0x7febe806e8b0 con 0x7febe8146d70 2024-04-15T14:59:55.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 10 monclient(hunting): my global_id is 4354 2024-04-15T14:59:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.622+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febe806f760 con 0x7febe8146d70 2024-04-15T14:59:55.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 10 monclient(hunting): picked mon.noname-b con 0x7f9b3c006a70 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 10 monclient(hunting): picked mon.noname-c con 0x7f9b3c02b100 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 10 monclient(hunting): picked mon.noname-a con 0x7f9b3c029c30 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c02c440 con 0x7f9b3c029c30 2024-04-15T14:59:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c0c9440 con 0x7f9b3c02b100 2024-04-15T14:59:55.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c0c9610 con 0x7f9b3c006a70 2024-04-15T14:59:55.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.623+0000 7f9b49ae4640 10 monclient(hunting): authenticate will time out at 1455.894588s 2024-04-15T14:59:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.628+0000 7fd9b0043640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.628+0000 7fd9b0043640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.628+0000 7fd9b0043640 10 monclient: monmap: 2024-04-15T14:59:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.650 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.630065+0000 2024-04-15T14:59:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.630065+0000 2024-04-15T14:59:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.651 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.652 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7f9b437fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f9b3c006a70 0x7f9b3c0c8d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45864/0 (socket says 172.21.15.38:45864) 2024-04-15T14:59:55.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7f9b437fe640 1 -- 172.21.15.38:0/3040437820 learned_addr learned my addr 172.21.15.38:0/3040437820 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3835605114 0 0) 0x7febe806f760 con 0x7febe8146d70 2024-04-15T14:59:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7febe806e8b0 con 0x7febe8146d70 2024-04-15T14:59:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7febe0001940 con 0x7febe8146d70 2024-04-15T14:59:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 10 monclient(hunting): dump: 2024-04-15T14:59:55.653 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 329645865 0 0) 0x7febcc004eb0 con 0x7febe80b57b0 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7febe806f760 con 0x7febe80b57b0 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7febe4001bc0 con 0x7febe80b57b0 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.629+0000 7febdeffd640 10 monclient(hunting): dump: 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.655 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.656 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.630+0000 7fd9b0043640 1 Processor -- start 2024-04-15T14:59:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.630+0000 7f1439ffb640 1 -- 172.21.15.38:0/906460509 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 306594362 0 0) 0x7f1434039840 con 0x7f14340389e0 2024-04-15T14:59:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.630+0000 7f1439ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.630+0000 7f1439ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.630+0000 7f1439ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.630+0000 7f1439ffb640 10 monclient(hunting): my global_id is 4357 2024-04-15T14:59:55.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.630+0000 7f1439ffb640 1 -- 172.21.15.38:0/906460509 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1424003520 con 0x7f14340389e0 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.630+0000 7fd9b0043640 1 -- start start 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.630+0000 7fd9b0043640 10 monclient: init 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.631+0000 7fd9b0043640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.631+0000 7fd9b0043640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.631+0000 7fd9b0043640 10 monclient(hunting): picked mon.noname-b con 0x7fd9a00389e0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.631+0000 7fd9b0043640 10 monclient(hunting): picked mon.noname-a con 0x7fd9a0038dc0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.631+0000 7fd9b0043640 10 monclient(hunting): picked mon.noname-c con 0x7fd9a0030660 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.631+0000 7fd9b0043640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a0036430 con 0x7fd9a0038dc0 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.631+0000 7fd9b0043640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a0039840 con 0x7fd9a0030660 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.631+0000 7fd9b0043640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a0035690 con 0x7fd9a00389e0 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.632+0000 7fd9b0043640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.632+0000 7fd9b0043640 10 monclient(hunting): authenticate will time out at 1455.903415s 2024-04-15T14:59:55.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.633+0000 7fd9adddf640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fd9a00389e0 0x7fd9a0033520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45878/0 (socket says 172.21.15.38:45878) 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.633+0000 7fd9adddf640 1 -- 172.21.15.38:0/598577258 learned_addr learned my addr 172.21.15.38:0/598577258 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.636+0000 7f1439ffb640 1 -- 172.21.15.38:0/906460509 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 894221480 0 0) 0x7f1424003520 con 0x7f14340389e0 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 1 -- 172.21.15.38:0/906460509 >> v1:172.21.15.38:6790/0 conn(0x7f1434030660 legacy=0x7f14340d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 1 -- 172.21.15.38:0/906460509 >> v1:172.21.15.38:6789/0 conn(0x7f1434038dc0 legacy=0x7f14340cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 1 monclient: found mon.noname-c 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 1 -- 172.21.15.38:0/906460509 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1434035f10 con 0x7f14340389e0 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 1 -- 172.21.15.38:0/906460509 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f1430001610 con 0x7f14340389e0 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f1439ffb640 10 monclient: dump: 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.660 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f143bfff640 5 monclient: authenticate success, global_id 4357 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7f143bfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7fd5f65fb640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7fd5f65fb640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7fd5f65fb640 10 monclient: monmap: 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.639245+0000 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.639245+0000 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.661 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.662 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.662 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.662 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.662 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2068640398 0 0) 0x7febe806e8b0 con 0x7febe8146d70 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 >> v1:172.21.15.38:6790/0 conn(0x7febe80b57b0 legacy=0x7febe81e2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 >> v1:172.21.15.38:6789/0 conn(0x7febe80b5b90 legacy=0x7febe81e85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 1 monclient: found mon.b 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe81e2950 con 0x7febe8146d70 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.637+0000 7febdeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7febf040d640 5 monclient: authenticate success, global_id 4354 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7febf040d640 10 monclient: _renew_subs 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7febf040d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7febe806de10 con 0x7febe8146d70 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7febf040d640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7febf040d640 10 monclient: _renew_subs 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7febf040d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7febe81414b0 con 0x7febe8146d70 2024-04-15T14:59:55.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7febf040d640 1 librados: init done 2024-04-15T14:59:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7fd5f65fb640 1 Processor -- start 2024-04-15T14:59:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7fd5f65fb640 1 -- start start 2024-04-15T14:59:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.638+0000 7fd5f65fb640 10 monclient: init 2024-04-15T14:59:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575738462 0 0) 0x7f9b3c0c9440 con 0x7f9b3c02b100 2024-04-15T14:59:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7f9b427fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7f9b427fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7f9b427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7f9b427fc640 10 monclient(hunting): my global_id is 4360 2024-04-15T14:59:55.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b34003520 con 0x7f9b3c02b100 2024-04-15T14:59:55.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7febf040d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7febf040d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7febf040d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febe80b8820 con 0x7febe8146d70 2024-04-15T14:59:55.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7fd5f65fb640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.639+0000 7fd5f65fb640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:55.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.640+0000 7fd5f65fb640 10 monclient(hunting): picked mon.noname-a con 0x7fd5f013f2e0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.640+0000 7fd5f65fb640 10 monclient(hunting): picked mon.noname-c con 0x7fd5f013ff00 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.640+0000 7fd5f65fb640 10 monclient(hunting): picked mon.noname-b con 0x7fd5f013f6c0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.640+0000 7fd5f65fb640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f013cf00 con 0x7fd5f013f2e0 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.640+0000 7fd5f65fb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f00b0cc0 con 0x7fd5f013ff00 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.640+0000 7fd5f65fb640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f00b1110 con 0x7fd5f013f6c0 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.640+0000 7fd5f65fb640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.640+0000 7fd5f65fb640 10 monclient(hunting): authenticate will time out at 1455.911851s 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.643+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293442003 0 0) 0x7fd9a0035690 con 0x7fd9a00389e0 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.643+0000 7fd9acddd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.643+0000 7fd9acddd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.643+0000 7fd9acddd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.643+0000 7fd9acddd640 10 monclient(hunting): my global_id is 54272 2024-04-15T14:59:55.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.643+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd994003520 con 0x7fd9a00389e0 2024-04-15T14:59:55.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.645+0000 7fd5f4b98640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fd5f013f6c0 0x7fd5f00ae420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45890/0 (socket says 172.21.15.38:45890) 2024-04-15T14:59:55.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.645+0000 7fd5f4b98640 1 -- 172.21.15.38:0/3104474870 learned_addr learned my addr 172.21.15.38:0/3104474870 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.645+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932346736 0 0) 0x7f9b3c02c440 con 0x7f9b3c029c30 2024-04-15T14:59:55.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.645+0000 7f9b427fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.645+0000 7f9b427fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.645+0000 7f9b427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.645+0000 7f9b427fc640 10 monclient(hunting): my global_id is 4368 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.645+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b3c0c9440 con 0x7f9b3c029c30 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.647+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782965647 0 0) 0x7f9b3c0c9610 con 0x7f9b3c006a70 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.647+0000 7f9b427fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.647+0000 7f9b427fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.647+0000 7f9b427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.647+0000 7f9b427fc640 10 monclient(hunting): my global_id is 54269 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.647+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b3c02c440 con 0x7f9b3c006a70 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.648+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262867022 0 0) 0x7fd9a4001110 con 0x7fd9a0038dc0 2024-04-15T14:59:55.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.648+0000 7fd9acddd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.648+0000 7fd9acddd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.648+0000 7fd9acddd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.648+0000 7fd9acddd640 10 monclient(hunting): my global_id is 4371 2024-04-15T14:59:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.648+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9a0035690 con 0x7fd9a0038dc0 2024-04-15T14:59:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.648+0000 7fe5f8fc5640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.648+0000 7fe5f8fc5640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.648+0000 7fe5f8fc5640 10 monclient: monmap: 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.650708+0000 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.650708+0000 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.649+0000 7fe5f8fc5640 1 Processor -- start 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.649+0000 7fe5f8fc5640 1 -- start start 2024-04-15T14:59:55.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.649+0000 7fe5f8fc5640 10 monclient: init 2024-04-15T14:59:55.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722511829 0 0) 0x7fd9a0039840 con 0x7fd9a0030660 2024-04-15T14:59:55.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fd9acddd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fd9acddd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fd9acddd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fd9acddd640 10 monclient(hunting): my global_id is 4363 2024-04-15T14:59:55.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9a4001110 con 0x7fd9a0030660 2024-04-15T14:59:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 10 monclient(hunting): picked mon.noname-a con 0x7fe5f40b57b0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 10 monclient(hunting): picked mon.noname-b con 0x7fe5f40b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 10 monclient(hunting): picked mon.noname-c con 0x7fe5f4146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f4140ca0 con 0x7fe5f40b57b0 2024-04-15T14:59:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f40ab0e0 con 0x7fe5f4146d70 2024-04-15T14:59:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f40b3310 con 0x7fe5f40b5b90 2024-04-15T14:59:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.650+0000 7fe5f8fc5640 10 monclient(hunting): authenticate will time out at 1455.922327s 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.653+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 970427227 0 0) 0x7fd994003520 con 0x7fd9a00389e0 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 >> v1:172.21.15.164:6789/0 conn(0x7fd9a0030660 legacy=0x7fd9a00d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 >> v1:172.21.15.38:6789/0 conn(0x7fd9a0038dc0 legacy=0x7fd9a00cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 1 monclient: found mon.noname-b 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a0035f10 con 0x7fd9a00389e0 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fd998001540 con 0x7fd9a00389e0 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9acddd640 10 monclient: dump: 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9b0043640 5 monclient: authenticate success, global_id 54272 2024-04-15T14:59:55.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.654+0000 7fd9b0043640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.657+0000 7fe5ebfff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fe5f40b5b90 0x7fe5f4146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45900/0 (socket says 172.21.15.38:45900) 2024-04-15T14:59:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.657+0000 7fe5ebfff640 1 -- 172.21.15.38:0/3048540436 learned_addr learned my addr 172.21.15.38:0/3048540436 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.658+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2730929644 0 0) 0x7fd5f00b1110 con 0x7fd5f013f6c0 2024-04-15T14:59:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.658+0000 7fd5eeffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.658+0000 7fd5eeffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.658+0000 7fd5eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.658+0000 7fd5eeffd640 10 monclient(hunting): my global_id is 54278 2024-04-15T14:59:55.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.658+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d8003520 con 0x7fd5f013f6c0 2024-04-15T14:59:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7febe0001f90 con 0x7febe8146d70 2024-04-15T14:59:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7febdeffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7febe0003b10 con 0x7febe8146d70 2024-04-15T14:59:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7febdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7febdeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7febdffff640 4 set_mon_vals no callback set 2024-04-15T14:59:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7febdeffd640 10 monclient: dump: 2024-04-15T14:59:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.679 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.680 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.680 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3947018716 0 0) 0x7f9b3c02c440 con 0x7f9b3c006a70 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 >> v1:172.21.15.164:6789/0 conn(0x7f9b3c02b100 legacy=0x7f9b3c0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 >> v1:172.21.15.38:6789/0 conn(0x7f9b3c029c30 legacy=0x7f9b3c0d74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 1 monclient: found mon.noname-b 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c0cf810 con 0x7f9b3c006a70 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b440502c0 con 0x7f9b3c006a70 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.660+0000 7f9b427fc640 10 monclient: dump: 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.661+0000 7f9b49ae4640 5 monclient: authenticate success, global_id 54269 2024-04-15T14:59:55.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.661+0000 7f9b49ae4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.661+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7febe0003d30 con 0x7febe8146d70 2024-04-15T14:59:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.662+0000 7febee1a9640 10 monclient: get_auth_request con 0x7febcc06eed0 auth_method 0 2024-04-15T14:59:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.662+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7febe00522a0 con 0x7febe8146d70 2024-04-15T14:59:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.662+0000 7febdeffd640 10 client.4354.objecter ms_dispatch 0x7febe8000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.662+0000 7febdeffd640 3 client.4354.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.662+0000 7febdeffd640 3 client.4354.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.662+0000 7febdeffd640 20 client.4354.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.662+0000 7febdeffd640 10 client.4354.objecter ms_handle_connect 0x7febcc06eed0 2024-04-15T14:59:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.664+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242054861 0 0) 0x7fe5f40b3310 con 0x7fe5f40b5b90 2024-04-15T14:59:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.664+0000 7fe5f1d9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.664+0000 7fe5f1d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.664+0000 7fe5f1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.664+0000 7fe5f1d9b640 10 monclient(hunting): my global_id is 54281 2024-04-15T14:59:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.664+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5e0003520 con 0x7fe5f40b5b90 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.665+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b44063620 con 0x7f9b3c006a70 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.665+0000 7f9b427fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.665+0000 7f9b427fc640 1 -- 172.21.15.38:0/3040437820 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b440692b0 con 0x7f9b3c006a70 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.665+0000 7f9b427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.665+0000 7f9b427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.665+0000 7f9b427fc640 10 monclient: dump: 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.686 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.665+0000 7f9b49ae4640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.665+0000 7f9b49ae4640 4 set_mon_vals no callback set 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7f9b49ae4640 10 monclient: shutdown 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7f9b49ae4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7f9b49ae4640 1 -- 172.21.15.38:0/3040437820 >> v1:172.21.15.38:6790/0 conn(0x7f9b3c006a70 legacy=0x7f9b3c0c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899143502 0 0) 0x7fd5e8001490 con 0x7fd5f013f2e0 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7fd5eeffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7fd5eeffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7fd5eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7fd5eeffd640 10 monclient(hunting): my global_id is 4374 2024-04-15T14:59:55.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f00b1110 con 0x7fd5f013f2e0 2024-04-15T14:59:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7f9b49ae4640 1 -- 172.21.15.38:0/3040437820 shutdown_connections 2024-04-15T14:59:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.666+0000 7f9b49ae4640 1 -- 172.21.15.38:0/3040437820 >> 172.21.15.38:0/3040437820 conn(0x7f9b3c0058f0 msgr2=0x7f9b3c005d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.667+0000 7f9b49ae4640 1 -- 172.21.15.38:0/3040437820 shutdown_connections 2024-04-15T14:59:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.667+0000 7f9b49ae4640 1 -- 172.21.15.38:0/3040437820 wait complete. 2024-04-15T14:59:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.667+0000 7f9b49ae4640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.667+0000 7f9b49ae4640 10 monclient: monmap: 2024-04-15T14:59:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.689 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.668+0000 7f9b49ae4640 1 librados: starting msgr at 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.668+0000 7f9b49ae4640 1 librados: starting objecter 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.668+0000 7f9b49ae4640 1 Processor -- start 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7f9b49ae4640 1 -- start start 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7f9b49ae4640 1 librados: setting wanted keys 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7f9b49ae4640 1 librados: calling monclient init 2024-04-15T14:59:55.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7f9b49ae4640 10 monclient: init 2024-04-15T14:59:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429789056 0 0) 0x7fe5f4140ca0 con 0x7fe5f40b57b0 2024-04-15T14:59:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7fe5f1d9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7fe5f1d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7fe5f1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7fe5f1d9b640 10 monclient(hunting): my global_id is 4377 2024-04-15T14:59:55.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.669+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5f40b3310 con 0x7fe5f40b57b0 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 10 monclient(hunting): picked mon.noname-a con 0x7f9b3c006a70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 10 monclient(hunting): picked mon.noname-b con 0x7f9b3c029c30 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 10 monclient(hunting): picked mon.noname-c con 0x7f9b3c031e10 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c02f5a0 con 0x7f9b3c006a70 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c165230 con 0x7f9b3c029c30 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c164e50 con 0x7f9b3c031e10 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.670+0000 7f9b49ae4640 10 monclient(hunting): authenticate will time out at 1455.941988s 2024-04-15T14:59:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9980017a0 con 0x7fd9a00389e0 2024-04-15T14:59:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9acddd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9acddd640 1 -- 172.21.15.38:0/598577258 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fd998001b70 con 0x7fd9a00389e0 2024-04-15T14:59:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9acddd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9acddd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9acddd640 10 monclient: dump: 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9b0043640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9b0043640 4 set_mon_vals no callback set 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9b0043640 10 monclient: shutdown 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9b0043640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.671+0000 7fd9b0043640 1 -- 172.21.15.38:0/598577258 >> v1:172.21.15.38:6790/0 conn(0x7fd9a00389e0 legacy=0x7fd9a0033520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd9b0043640 1 -- 172.21.15.38:0/598577258 shutdown_connections 2024-04-15T14:59:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd9b0043640 1 -- 172.21.15.38:0/598577258 >> 172.21.15.38:0/598577258 conn(0x7fd9a0005c00 msgr2=0x7fd9a0006010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd9b0043640 1 -- 172.21.15.38:0/598577258 shutdown_connections 2024-04-15T14:59:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1197133079 0 0) 0x7fd5d8003520 con 0x7fd5f013f6c0 2024-04-15T14:59:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 >> v1:172.21.15.164:6789/0 conn(0x7fd5f013ff00 legacy=0x7fd5f00ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 >> v1:172.21.15.38:6789/0 conn(0x7fd5f013f2e0 legacy=0x7fd5f00aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 1 monclient: found mon.noname-b 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f00b0490 con 0x7fd5f013f6c0 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fd5e4004c50 con 0x7fd5f013f6c0 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd5eeffd640 10 monclient: dump: 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.697 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.698 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.698 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.698 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.698 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.698 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.698 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.698 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.672+0000 7fd9b0043640 1 -- 172.21.15.38:0/598577258 wait complete. 2024-04-15T14:59:55.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.673+0000 7fd5f65fb640 5 monclient: authenticate success, global_id 54278 2024-04-15T14:59:55.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.673+0000 7fd5f65fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.673+0000 7fd9b0043640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.673+0000 7fd9b0043640 10 monclient: monmap: 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.673+0000 7fd9b0043640 1 librados: starting msgr at 2024-04-15T14:59:55.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.673+0000 7fd9b0043640 1 librados: starting objecter 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.674+0000 7fd9b0043640 1 Processor -- start 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.674+0000 7fd9b0043640 1 -- start start 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.674+0000 7fd9b0043640 1 librados: setting wanted keys 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.674+0000 7fd9b0043640 1 librados: calling monclient init 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.674+0000 7fd9b0043640 10 monclient: init 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 10 monclient(hunting): picked mon.noname-a con 0x7fd9a0030660 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 10 monclient(hunting): picked mon.noname-b con 0x7fd9a00389e0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 10 monclient(hunting): picked mon.noname-c con 0x7fd9a015cad0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a00c0430 con 0x7fd9a0030660 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a00bec60 con 0x7fd9a00389e0 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a0160120 con 0x7fd9a015cad0 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.675+0000 7fd9b0043640 10 monclient(hunting): authenticate will time out at 1455.947356s 2024-04-15T14:59:55.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.676+0000 7f9b43fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f9b3c031e10 0x7f9b3c02da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45906/0 (socket says 172.21.15.38:45906) 2024-04-15T14:59:55.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.676+0000 7f9b43fff640 1 -- 172.21.15.38:0/2231259611 learned_addr learned my addr 172.21.15.38:0/2231259611 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2824111548 0 0) 0x7fe5e0003520 con 0x7fe5f40b5b90 2024-04-15T14:59:55.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 >> v1:172.21.15.164:6789/0 conn(0x7fe5f4146d70 legacy=0x7fe5f414ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 >> v1:172.21.15.38:6789/0 conn(0x7fe5f40b57b0 legacy=0x7fe5f4140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 1 monclient: found mon.noname-b 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f40aa460 con 0x7fe5f40b5b90 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe5e4001610 con 0x7fe5f40b5b90 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f1d9b640 10 monclient: dump: 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.704 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f8fc5640 5 monclient: authenticate success, global_id 54281 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7fe5f8fc5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7f9b2ffff640 10 client.?.objecter ms_handle_connect 0x7f9b3c031e10 2024-04-15T14:59:55.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.677+0000 7f9b2ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.679+0000 7fd9ae5e0640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fd9a015cad0 0x7fd9a00be530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45908/0 (socket says 172.21.15.38:45908) 2024-04-15T14:59:55.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.679+0000 7fd9ae5e0640 1 -- 172.21.15.38:0/1543406849 learned_addr learned my addr 172.21.15.38:0/1543406849 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7fd99e7fc640 10 client.?.objecter ms_handle_connect 0x7fd9a0030660 2024-04-15T14:59:55.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7fd99e7fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990257796 0 0) 0x7f9b3c164e50 con 0x7f9b3c031e10 2024-04-15T14:59:55.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7f9b2ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7f9b2ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7f9b2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7f9b2ffff640 10 monclient(hunting): my global_id is 54284 2024-04-15T14:59:55.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b28004eb0 con 0x7f9b3c031e10 2024-04-15T14:59:55.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7fd99e7fc640 10 client.?.objecter ms_handle_connect 0x7fd9a015cad0 2024-04-15T14:59:55.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7fd99e7fc640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7f9b2ffff640 10 client.?.objecter ms_handle_connect 0x7f9b3c006a70 2024-04-15T14:59:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.682+0000 7f9b2ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.686+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1100670616 0 0) 0x7fd9a00c0430 con 0x7fd9a0030660 2024-04-15T14:59:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.686+0000 7fd99e7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.686+0000 7fd99e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.686+0000 7fd99e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.686+0000 7fd99e7fc640 10 monclient(hunting): my global_id is 4380 2024-04-15T14:59:55.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.686+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd98c004eb0 con 0x7fd9a0030660 2024-04-15T14:59:55.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.687+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720600028 0 0) 0x7f9b3c02f5a0 con 0x7f9b3c006a70 2024-04-15T14:59:55.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.687+0000 7f9b2ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.687+0000 7f9b2ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.687+0000 7f9b2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.687+0000 7f9b2ffff640 10 monclient(hunting): my global_id is 4383 2024-04-15T14:59:55.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.687+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b3c164e50 con 0x7f9b3c006a70 2024-04-15T14:59:55.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.692+0000 7f480e396640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.692+0000 7f480e396640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.692+0000 7f480e396640 10 monclient: monmap: 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.693969+0000 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.693969+0000 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.710 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.692+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1214997186 0 0) 0x7fd98c004eb0 con 0x7fd9a0030660 2024-04-15T14:59:55.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.692+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9a00c0430 con 0x7fd9a0030660 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 1 Processor -- start 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 1 -- start start 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 10 monclient: init 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 10 monclient(hunting): picked mon.noname-b con 0x7f48080b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 10 monclient(hunting): picked mon.noname-a con 0x7f48080b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 10 monclient(hunting): picked mon.noname-c con 0x7f4808146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4808140ca0 con 0x7f48080b5b90 2024-04-15T14:59:55.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48080ab0e0 con 0x7f4808146d70 2024-04-15T14:59:55.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48080b3310 con 0x7f48080b57b0 2024-04-15T14:59:55.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.693+0000 7f480e396640 10 monclient(hunting): authenticate will time out at 1455.965370s 2024-04-15T14:59:55.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 277090711 0 0) 0x7f9b28004eb0 con 0x7f9b3c031e10 2024-04-15T14:59:55.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b3c02f5a0 con 0x7f9b3c031e10 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b300018d0 con 0x7f9b3c031e10 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7f9b2ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7f9b2ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7f9b2ffff640 10 monclient(hunting): dump: 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7f9b2ffff640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe5e4001870 con 0x7fe5f40b5b90 2024-04-15T14:59:55.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7fe5f1d9b640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7fe5f1d9b640 1 -- 172.21.15.38:0/3048540436 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe5e4001c40 con 0x7fe5f40b5b90 2024-04-15T14:59:55.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7fe5f1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7fe5f1d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7fe5f1d9b640 10 monclient: dump: 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7fe5f8fc5640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.695+0000 7fe5f8fc5640 4 set_mon_vals no callback set 2024-04-15T14:59:55.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2111185350 0 0) 0x7fd9a4001110 con 0x7fd9a015cad0 2024-04-15T14:59:55.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd99e7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd99e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd99e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd99e7fc640 10 monclient(hunting): my global_id is 54287 2024-04-15T14:59:55.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd98c004eb0 con 0x7fd9a015cad0 2024-04-15T14:59:55.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5e4004eb0 con 0x7fd5f013f6c0 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd5eeffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd5eeffd640 1 -- 172.21.15.38:0/3104474870 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fd5e40013d0 con 0x7fd5f013f6c0 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd5eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd5eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd5eeffd640 10 monclient: dump: 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.718 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.719 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd5f65fb640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fd5f65fb640 4 set_mon_vals no callback set 2024-04-15T14:59:55.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fe5f8fc5640 10 monclient: shutdown 2024-04-15T14:59:55.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fe5f8fc5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.696+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/3048540436 >> v1:172.21.15.38:6790/0 conn(0x7fe5f40b5b90 legacy=0x7fe5f4146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fd5f65fb640 10 monclient: shutdown 2024-04-15T14:59:55.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fd5f65fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fd5f65fb640 1 -- 172.21.15.38:0/3104474870 >> v1:172.21.15.38:6790/0 conn(0x7fd5f013f6c0 legacy=0x7fd5f00ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fd5f65fb640 1 -- 172.21.15.38:0/3104474870 shutdown_connections 2024-04-15T14:59:55.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fd5f65fb640 1 -- 172.21.15.38:0/3104474870 >> 172.21.15.38:0/3104474870 conn(0x7fd5f0068140 msgr2=0x7fd5f00b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/3048540436 shutdown_connections 2024-04-15T14:59:55.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/3048540436 >> 172.21.15.38:0/3048540436 conn(0x7fe5f4067790 msgr2=0x7fe5f4067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fd5f65fb640 1 -- 172.21.15.38:0/3104474870 shutdown_connections 2024-04-15T14:59:55.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fd5f65fb640 1 -- 172.21.15.38:0/3104474870 wait complete. 2024-04-15T14:59:55.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/3048540436 shutdown_connections 2024-04-15T14:59:55.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.697+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/3048540436 wait complete. 2024-04-15T14:59:55.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.698+0000 7fd5f65fb640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.698+0000 7fd5f65fb640 10 monclient: monmap: 2024-04-15T14:59:55.722 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.722 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.722 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.698+0000 7fd5f65fb640 1 librados: starting msgr at 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.698+0000 7fd5f65fb640 1 librados: starting objecter 2024-04-15T14:59:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.698+0000 7fd5f65fb640 1 Processor -- start 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.698+0000 7fe5f8fc5640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.698+0000 7fe5f8fc5640 10 monclient: monmap: 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.724 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 1 -- start start 2024-04-15T14:59:55.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 1 librados: setting wanted keys 2024-04-15T14:59:55.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 1 librados: calling monclient init 2024-04-15T14:59:55.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 10 monclient: init 2024-04-15T14:59:55.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fe5f8fc5640 1 librados: starting msgr at 2024-04-15T14:59:55.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fe5f8fc5640 1 librados: starting objecter 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3535635731 0 0) 0x7f9b3c02f5a0 con 0x7f9b3c031e10 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 >> v1:172.21.15.164:6789/0 conn(0x7f9b3c029c30 legacy=0x7f9b3c02d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 >> v1:172.21.15.38:6789/0 conn(0x7f9b3c006a70 legacy=0x7f9b3c164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 1 monclient: found mon.c 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c16fac0 con 0x7f9b3c031e10 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b49ae4640 5 monclient: authenticate success, global_id 54284 2024-04-15T14:59:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fe5f8fc5640 1 Processor -- start 2024-04-15T14:59:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b49ae4640 10 monclient: _renew_subs 2024-04-15T14:59:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b49ae4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c16ca90 con 0x7f9b3c031e10 2024-04-15T14:59:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fe5f8fc5640 1 -- start start 2024-04-15T14:59:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fe5f8fc5640 1 librados: setting wanted keys 2024-04-15T14:59:55.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b49ae4640 10 client.54284.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fe5f8fc5640 1 librados: calling monclient init 2024-04-15T14:59:55.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fe5f8fc5640 10 monclient: init 2024-04-15T14:59:55.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b49ae4640 10 monclient: _renew_subs 2024-04-15T14:59:55.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b49ae4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b3c16cf60 con 0x7f9b3c031e10 2024-04-15T14:59:55.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 10 monclient(hunting): picked mon.noname-a con 0x7fd5f013f2e0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 10 monclient(hunting): picked mon.noname-c con 0x7fd5f013f6c0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 10 monclient(hunting): picked mon.noname-b con 0x7fd5f013ff00 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f01c9060 con 0x7fd5f013f2e0 2024-04-15T14:59:55.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f013b040 con 0x7fd5f013ff00 2024-04-15T14:59:55.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f01e0b90 con 0x7fd5f013f6c0 2024-04-15T14:59:55.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.699+0000 7fd5f65fb640 10 monclient(hunting): authenticate will time out at 1455.971375s 2024-04-15T14:59:55.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.700+0000 7f9b49ae4640 1 librados: init done 2024-04-15T14:59:55.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.700+0000 7fe5f8fc5640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.700+0000 7fe5f8fc5640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.700+0000 7fe5f8fc5640 10 monclient(hunting): picked mon.noname-b con 0x7fe5f40b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7fe5f8fc5640 10 monclient(hunting): picked mon.noname-c con 0x7fe5f40b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7fe5f8fc5640 10 monclient(hunting): picked mon.noname-a con 0x7fe5f4146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7fe5f8fc5640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f41360c0 con 0x7fe5f4146d70 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7fe5f8fc5640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f4137da0 con 0x7fe5f40b57b0 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7fe5f8fc5640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f413db00 con 0x7fe5f40b5b90 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7f9b49ae4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7f9b49ae4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7f9b49ae4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:55.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7fe5f8fc5640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c165020 con 0x7f9b3c031e10 2024-04-15T14:59:55.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.701+0000 7fe5f8fc5640 10 monclient(hunting): authenticate will time out at 1455.972840s 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.702+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fd998001bf0 con 0x7fd9a0030660 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.702+0000 7fd99e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.702+0000 7fd99e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.702+0000 7fd99e7fc640 10 monclient(hunting): dump: 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.735 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.702+0000 7fd99e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.702+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3993547873 0 0) 0x7fd9a00c0430 con 0x7fd9a0030660 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 >> v1:172.21.15.38:6790/0 conn(0x7fd9a015cad0 legacy=0x7fd9a00be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 >> v1:172.21.15.164:6789/0 conn(0x7fd9a00389e0 legacy=0x7fd9a00bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 1 monclient: found mon.a 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a0160d50 con 0x7fd9a0030660 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd99e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd9b0043640 5 monclient: authenticate success, global_id 4380 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd9b0043640 10 monclient: _renew_subs 2024-04-15T14:59:55.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd9b0043640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a00c3960 con 0x7fd9a0030660 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd9b0043640 10 client.4380.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd9b0043640 10 monclient: _renew_subs 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd9b0043640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd9a00c8130 con 0x7fd9a0030660 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.703+0000 7fd9b0043640 1 librados: init done 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.704+0000 7fd9b0043640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.704+0000 7fd9b0043640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.704+0000 7fd9b0043640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.704+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a0005120 con 0x7fd9a0030660 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.705+0000 7f48077fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f48080b5b90 0x7f4808146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55792/0 (socket says 172.21.15.38:55792) 2024-04-15T14:59:55.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.705+0000 7f48077fe640 1 -- 172.21.15.38:0/444892897 learned_addr learned my addr 172.21.15.38:0/444892897 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.705+0000 7fd5effff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd5f013f2e0 0x7fd5f006e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55794/0 (socket says 172.21.15.38:55794) 2024-04-15T14:59:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.705+0000 7fd5effff640 1 -- 172.21.15.38:0/222257339 learned_addr learned my addr 172.21.15.38:0/222257339 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.714+0000 7fd5ecff9640 10 client.?.objecter ms_handle_connect 0x7fd5f013f2e0 2024-04-15T14:59:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.715+0000 7fd5ecff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.715+0000 7fe5f2d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe5f4146d70 0x7fe5f41e3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55808/0 (socket says 172.21.15.38:55808) 2024-04-15T14:59:55.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.716+0000 7fe5f2d9d640 1 -- 172.21.15.38:0/121780642 learned_addr learned my addr 172.21.15.38:0/121780642 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.723+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b30001ce0 con 0x7f9b3c031e10 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.723+0000 7f9b2ffff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.723+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b30001730 con 0x7f9b3c031e10 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7f9b2ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7f9b2ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7f9b2ffff640 10 monclient: dump: 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.739 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7f9b41ffb640 4 set_mon_vals no callback set 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f9b30003940 con 0x7f9b3c031e10 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9980017a0 con 0x7fd9a0030660 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7fd99e7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fd998004c30 con 0x7fd9a0030660 2024-04-15T14:59:55.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7fd99e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7fd99e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7fd99e7fc640 10 monclient: dump: 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.724+0000 7fd99ffff640 4 set_mon_vals no callback set 2024-04-15T14:59:55.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.725+0000 7fe5eaffd640 10 client.?.objecter ms_handle_connect 0x7fe5f4146d70 2024-04-15T14:59:55.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.725+0000 7fe5eaffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.725+0000 7f9b437fe640 10 monclient: get_auth_request con 0x7f9b2806f090 auth_method 0 2024-04-15T14:59:55.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.725+0000 7f9b2ffff640 10 client.54284.objecter ms_handle_connect 0x7f9b2806f090 2024-04-15T14:59:55.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.726+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fd99801b160 con 0x7fd9a0030660 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.726+0000 7fec7ab24640 10 monclient: get_monmap_and_config 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.726+0000 7fec7ab24640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.726+0000 7fec7ab24640 10 monclient: monmap: 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:55.727882+0000 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:55.727882+0000 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.743 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:55.744 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:55.744 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.726+0000 7fd9ad5de640 10 monclient: get_auth_request con 0x7fd98c06ee60 auth_method 0 2024-04-15T14:59:55.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.726+0000 7fd99e7fc640 10 client.4380.objecter ms_handle_connect 0x7fd98c06ee60 2024-04-15T14:59:55.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 1 Processor -- start 2024-04-15T14:59:55.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 1 -- start start 2024-04-15T14:59:55.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 10 monclient: init 2024-04-15T14:59:55.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 10 monclient(hunting): picked mon.noname-b con 0x7fec740b57d0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 10 monclient(hunting): picked mon.noname-c con 0x7fec740b5bb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 10 monclient(hunting): picked mon.noname-a con 0x7fec74140b30 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec74146e10 con 0x7fec74140b30 2024-04-15T14:59:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec740aa840 con 0x7fec740b5bb0 2024-04-15T14:59:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec740aa460 con 0x7fec740b57d0 2024-04-15T14:59:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.727+0000 7fec7ab24640 10 monclient(hunting): authenticate will time out at 1455.999307s 2024-04-15T14:59:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.777+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fd9980533e0 con 0x7fd9a0030660 2024-04-15T14:59:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.777+0000 7fd99e7fc640 10 client.4380.objecter ms_dispatch 0x7fd9a8000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.777+0000 7fd99e7fc640 3 client.4380.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.777+0000 7fd99e7fc640 3 client.4380.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.777+0000 7fd99e7fc640 20 client.4380.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.869+0000 7f1439ffb640 1 -- 172.21.15.38:0/906460509 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14300018e0 con 0x7f14340389e0 2024-04-15T14:59:55.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.869+0000 7f1439ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.869+0000 7f143bfff640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.871 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.869+0000 7f143bfff640 4 set_mon_vals no callback set 2024-04-15T14:59:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.870+0000 7f143bfff640 10 monclient: shutdown 2024-04-15T14:59:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.870+0000 7f143bfff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.870+0000 7f143bfff640 1 -- 172.21.15.38:0/906460509 >> v1:172.21.15.164:6789/0 conn(0x7f14340389e0 legacy=0x7f1434033520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.870+0000 7f143bfff640 1 -- 172.21.15.38:0/906460509 shutdown_connections 2024-04-15T14:59:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.870+0000 7f143bfff640 1 -- 172.21.15.38:0/906460509 >> 172.21.15.38:0/906460509 conn(0x7f1434005c00 msgr2=0x7f1434006010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.870+0000 7f143bfff640 1 -- 172.21.15.38:0/906460509 shutdown_connections 2024-04-15T14:59:55.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.870+0000 7f143bfff640 1 -- 172.21.15.38:0/906460509 wait complete. 2024-04-15T14:59:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.871+0000 7f143bfff640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.871+0000 7f143bfff640 10 monclient: monmap: 2024-04-15T14:59:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.873 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.874 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.874 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.874 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.874 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.871+0000 7f143bfff640 1 librados: starting msgr at 2024-04-15T14:59:55.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.871+0000 7f143bfff640 1 librados: starting objecter 2024-04-15T14:59:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.871+0000 7f143bfff640 1 Processor -- start 2024-04-15T14:59:55.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 1 -- start start 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 1 librados: setting wanted keys 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 1 librados: calling monclient init 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 10 monclient: init 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f1434030660 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f14340389e0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f14340c85e0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143402fb50 con 0x7f14340389e0 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.872+0000 7f143bfff640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14340c4490 con 0x7f1434030660 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.873+0000 7f143bfff640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14340c4660 con 0x7f14340c85e0 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.873+0000 7f143bfff640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.873+0000 7f143bfff640 10 monclient(hunting): authenticate will time out at 1456.144423s 2024-04-15T14:59:55.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.906+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7febe80b8820 con 0x7febe8146d70 2024-04-15T14:59:55.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.906+0000 7febdeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.906+0000 7febdeffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:55.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.911+0000 7fd5ecff9640 10 client.?.objecter ms_handle_connect 0x7fd5f013ff00 2024-04-15T14:59:55.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.911+0000 7fd5ecff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.911+0000 7fe5eaffd640 10 client.?.objecter ms_handle_connect 0x7fe5f40b57b0 2024-04-15T14:59:55.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.911+0000 7fe5eaffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.915+0000 7fec73fff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fec740b5bb0 0x7fec74140420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:37024/0 (socket says 172.21.15.38:37024) 2024-04-15T14:59:55.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.916+0000 7fec73fff640 1 -- 172.21.15.38:0/522794825 learned_addr learned my addr 172.21.15.38:0/522794825 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.916+0000 7f143affd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f1434030660 0x7f14340c7ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:37034/0 (socket says 172.21.15.38:37034) 2024-04-15T14:59:55.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.916+0000 7f143affd640 1 -- 172.21.15.38:0/3111291864 learned_addr learned my addr 172.21.15.38:0/3111291864 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.917+0000 7f14237fe640 10 client.?.objecter ms_handle_connect 0x7f1434030660 2024-04-15T14:59:55.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.917+0000 7f14237fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.917+0000 7f4806ffd640 1 -- 172.21.15.38:0/444892897 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592286264 0 0) 0x7f48080ab0e0 con 0x7f4808146d70 2024-04-15T14:59:55.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.917+0000 7f4806ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.917+0000 7f4806ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.917+0000 7f4806ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.917+0000 7f4806ffd640 10 monclient(hunting): my global_id is 4369 2024-04-15T14:59:55.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.917+0000 7f4806ffd640 1 -- 172.21.15.38:0/444892897 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f0003520 con 0x7f4808146d70 2024-04-15T14:59:55.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396409775 0 0) 0x7fd5f013b040 con 0x7fd5f013ff00 2024-04-15T14:59:55.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fd5ecff9640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fd5ecff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fd5ecff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fd5ecff9640 10 monclient(hunting): my global_id is 4366 2024-04-15T14:59:55.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5dc004eb0 con 0x7fd5f013ff00 2024-04-15T14:59:55.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fec737fe640 1 -- 172.21.15.38:0/522794825 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365234366 0 0) 0x7fec740aa840 con 0x7fec740b5bb0 2024-04-15T14:59:55.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fec737fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fec737fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fec737fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fec737fe640 10 monclient(hunting): my global_id is 4378 2024-04-15T14:59:55.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.921+0000 7fec737fe640 1 -- 172.21.15.38:0/522794825 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec64003520 con 0x7fec740b5bb0 2024-04-15T14:59:55.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.922+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345807888 0 0) 0x7fe5f4137da0 con 0x7fe5f40b57b0 2024-04-15T14:59:55.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.922+0000 7fe5eaffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.922+0000 7fe5eaffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.922+0000 7fe5eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.922+0000 7fe5eaffd640 10 monclient(hunting): my global_id is 4372 2024-04-15T14:59:55.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.922+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5d4004eb0 con 0x7fe5f40b57b0 2024-04-15T14:59:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.924+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521463 0 0) 0x7f14340c4490 con 0x7f1434030660 2024-04-15T14:59:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.924+0000 7f14237fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:55.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.924+0000 7f14237fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.924+0000 7f14237fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.924+0000 7f14237fe640 10 monclient(hunting): my global_id is 4375 2024-04-15T14:59:55.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.924+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1428004eb0 con 0x7f1434030660 2024-04-15T14:59:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 1 -- 172.21.15.38:0/444892897 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2725684979 0 0) 0x7f47f0003520 con 0x7f4808146d70 2024-04-15T14:59:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 1 -- 172.21.15.38:0/444892897 >> v1:172.21.15.38:6790/0 conn(0x7f48080b57b0 legacy=0x7f4808140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 1 -- 172.21.15.38:0/444892897 >> v1:172.21.15.38:6789/0 conn(0x7f48080b5b90 legacy=0x7f4808146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 1 monclient: found mon.noname-c 2024-04-15T14:59:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 1 -- 172.21.15.38:0/444892897 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48080aa460 con 0x7f4808146d70 2024-04-15T14:59:55.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 1 -- 172.21.15.38:0/444892897 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f4800001990 con 0x7f4808146d70 2024-04-15T14:59:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f4806ffd640 10 monclient: dump: 2024-04-15T14:59:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.933 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.935 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.935 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f480e396640 5 monclient: authenticate success, global_id 4369 2024-04-15T14:59:55.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.925+0000 7f480e396640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.938+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 912538718 0 0) 0x7fe5d4004eb0 con 0x7fe5f40b57b0 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.938+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe5f4137da0 con 0x7fe5f40b57b0 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.938+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe5dc001950 con 0x7fe5f40b57b0 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.938+0000 7fe5eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.938+0000 7fe5eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.938+0000 7fe5eaffd640 10 monclient(hunting): dump: 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.943 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.938+0000 7fe5eaffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.941+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 708272626 0 0) 0x7f1428004eb0 con 0x7f1434030660 2024-04-15T14:59:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.941+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14340c4490 con 0x7f1434030660 2024-04-15T14:59:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.941+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f1430001550 con 0x7f1434030660 2024-04-15T14:59:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.941+0000 7f14237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.941+0000 7f14237fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.941+0000 7f14237fe640 10 monclient(hunting): dump: 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.941+0000 7f14237fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.942+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 142743885 0 0) 0x7fd5dc004eb0 con 0x7fd5f013ff00 2024-04-15T14:59:55.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.942+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5f013b040 con 0x7fd5f013ff00 2024-04-15T14:59:55.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.942+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fd5e4004b50 con 0x7fd5f013ff00 2024-04-15T14:59:55.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.942+0000 7fd5ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:55.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.942+0000 7fd5ecff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:55.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.942+0000 7fd5ecff9640 10 monclient(hunting): dump: 2024-04-15T14:59:55.945 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.942+0000 7fd5ecff9640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f4806ffd640 1 -- 172.21.15.38:0/444892897 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4800001bf0 con 0x7f4808146d70 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f4806ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f4806ffd640 1 -- 172.21.15.38:0/444892897 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f4800002000 con 0x7f4808146d70 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f4806ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f4806ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f4806ffd640 10 monclient: dump: 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.947 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.948 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f480e396640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f480e396640 4 set_mon_vals no callback set 2024-04-15T14:59:55.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 1 -- 172.21.15.38:0/522794825 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 434112757 0 0) 0x7fec64003520 con 0x7fec740b5bb0 2024-04-15T14:59:55.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 1 -- 172.21.15.38:0/522794825 >> v1:172.21.15.38:6790/0 conn(0x7fec740b57d0 legacy=0x7fec74146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:55.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 1 -- 172.21.15.38:0/522794825 >> v1:172.21.15.38:6789/0 conn(0x7fec74140b30 legacy=0x7fec7414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:55.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 1 monclient: found mon.noname-c 2024-04-15T14:59:55.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 1 -- 172.21.15.38:0/522794825 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec740b2970 con 0x7fec740b5bb0 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 1 -- 172.21.15.38:0/522794825 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec60001610 con 0x7fec740b5bb0 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec737fe640 10 monclient: dump: 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.952 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.953 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec7ab24640 5 monclient: authenticate success, global_id 4378 2024-04-15T14:59:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7fec7ab24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f480e396640 10 monclient: shutdown 2024-04-15T14:59:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f480e396640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.943+0000 7f480e396640 1 -- 172.21.15.38:0/444892897 >> v1:172.21.15.164:6789/0 conn(0x7f4808146d70 legacy=0x7f480814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.944+0000 7f480e396640 1 -- 172.21.15.38:0/444892897 shutdown_connections 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.944+0000 7f480e396640 1 -- 172.21.15.38:0/444892897 >> 172.21.15.38:0/444892897 conn(0x7f4808067790 msgr2=0x7f4808067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.944+0000 7f480e396640 1 -- 172.21.15.38:0/444892897 shutdown_connections 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.944+0000 7f480e396640 1 -- 172.21.15.38:0/444892897 wait complete. 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.945+0000 7f480e396640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.945+0000 7f480e396640 10 monclient: monmap: 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.956 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.945+0000 7f480e396640 1 librados: starting msgr at 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.945+0000 7f480e396640 1 librados: starting objecter 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.945+0000 7f480e396640 1 Processor -- start 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.945+0000 7f480e396640 1 -- start start 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.945+0000 7f480e396640 1 librados: setting wanted keys 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.945+0000 7f480e396640 1 librados: calling monclient init 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.945+0000 7f480e396640 10 monclient: init 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.946+0000 7f480e396640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.946+0000 7f480e396640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.946+0000 7f480e396640 10 monclient(hunting): picked mon.noname-b con 0x7f48080b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.946+0000 7f480e396640 10 monclient(hunting): picked mon.noname-a con 0x7f48080b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.946+0000 7f480e396640 10 monclient(hunting): picked mon.noname-c con 0x7f4808146d70 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.946+0000 7f480e396640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480813d4b0 con 0x7f48080b5b90 2024-04-15T14:59:55.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.946+0000 7f480e396640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480813d8d0 con 0x7f48080b57b0 2024-04-15T14:59:55.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7f480e396640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480813daa0 con 0x7f4808146d70 2024-04-15T14:59:55.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7f480e396640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7f480e396640 10 monclient(hunting): authenticate will time out at 1456.218415s 2024-04-15T14:59:55.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2679312273 0 0) 0x7fe5f4137da0 con 0x7fe5f40b57b0 2024-04-15T14:59:55.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 >> v1:172.21.15.38:6790/0 conn(0x7fe5f40b5b90 legacy=0x7fe5f41d57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 >> v1:172.21.15.38:6789/0 conn(0x7fe5f4146d70 legacy=0x7fe5f41e3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 1 monclient: found mon.b 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f41d5130 con 0x7fe5f40b57b0 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5f8fc5640 5 monclient: authenticate success, global_id 4372 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5f8fc5640 10 monclient: _renew_subs 2024-04-15T14:59:55.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5f8fc5640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.947+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f4135c60 con 0x7fe5f40b57b0 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.948+0000 7fe5f8fc5640 10 client.4372.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.948+0000 7fe5f8fc5640 10 monclient: _renew_subs 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.948+0000 7fe5f8fc5640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.948+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe5f41dc8e0 con 0x7fe5f40b57b0 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.948+0000 7fe5f8fc5640 1 librados: init done 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.948+0000 7fe5f8fc5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.948+0000 7fe5f8fc5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.948+0000 7fe5f8fc5640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.948+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f4077050 con 0x7fe5f40b57b0 2024-04-15T14:59:55.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3587196491 0 0) 0x7f14340c4490 con 0x7f1434030660 2024-04-15T14:59:55.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 >> v1:172.21.15.38:6790/0 conn(0x7f14340c85e0 legacy=0x7f1434167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 >> v1:172.21.15.38:6789/0 conn(0x7f14340389e0 legacy=0x7f143415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 1 monclient: found mon.b 2024-04-15T14:59:55.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143415d1e0 con 0x7f1434030660 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f14237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f143bfff640 5 monclient: authenticate success, global_id 4375 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f143bfff640 10 monclient: _renew_subs 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f143bfff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f143415d4d0 con 0x7f1434030660 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f143bfff640 10 client.4375.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f143bfff640 10 monclient: _renew_subs 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f143bfff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1434168e90 con 0x7f1434030660 2024-04-15T14:59:55.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.954+0000 7f143bfff640 1 librados: init done 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1434786404 0 0) 0x7fd5f013b040 con 0x7fd5f013ff00 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 >> v1:172.21.15.38:6790/0 conn(0x7fd5f013f6c0 legacy=0x7fd5f0071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 >> v1:172.21.15.38:6789/0 conn(0x7fd5f013f2e0 legacy=0x7fd5f006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 10 monclient: _finish_hunting 0 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 1 monclient: found mon.b 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f006f080 con 0x7fd5f013ff00 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 10 monclient: _finish_auth 0 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 10 monclient: _check_auth_tickets 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:55.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5f65fb640 5 monclient: authenticate success, global_id 4366 2024-04-15T14:59:55.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5f65fb640 10 monclient: _renew_subs 2024-04-15T14:59:55.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5f65fb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.955+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f01e0070 con 0x7fd5f013ff00 2024-04-15T14:59:55.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fd5f65fb640 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:55.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fd5f65fb640 10 monclient: _renew_subs 2024-04-15T14:59:55.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fd5f65fb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd5f01e8a60 con 0x7fd5f013ff00 2024-04-15T14:59:55.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7f143bfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7f143bfff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fd5f65fb640 1 librados: init done 2024-04-15T14:59:55.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7f143bfff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1434005120 con 0x7f1434030660 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fec737fe640 1 -- 172.21.15.38:0/522794825 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec60001870 con 0x7fec740b5bb0 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fec737fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fec737fe640 1 -- 172.21.15.38:0/522794825 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec60001cc0 con 0x7fec740b5bb0 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fec737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fec737fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fec737fe640 10 monclient: dump: 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.968 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:55.969 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:55.969 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:55.969 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:55.969 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:55.969 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:55.969 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fec7ab24640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:55.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.956+0000 7fec7ab24640 4 set_mon_vals no callback set 2024-04-15T14:59:55.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fd5f65fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fd5f65fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fd5f65fb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:55.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f006f310 con 0x7fd5f013ff00 2024-04-15T14:59:55.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fec7ab24640 10 monclient: shutdown 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fec7ab24640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fec7ab24640 1 -- 172.21.15.38:0/522794825 >> v1:172.21.15.164:6789/0 conn(0x7fec740b5bb0 legacy=0x7fec74140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fec7ab24640 1 -- 172.21.15.38:0/522794825 shutdown_connections 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fec7ab24640 1 -- 172.21.15.38:0/522794825 >> 172.21.15.38:0/522794825 conn(0x7fec74067790 msgr2=0x7fec74067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fec7ab24640 1 -- 172.21.15.38:0/522794825 shutdown_connections 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.957+0000 7fec7ab24640 1 -- 172.21.15.38:0/522794825 wait complete. 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.958+0000 7fec7ab24640 10 monclient: build_initial_monmap 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.958+0000 7fec7ab24640 10 monclient: monmap: 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:55.974 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.958+0000 7fec7ab24640 1 librados: starting msgr at 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.958+0000 7fec7ab24640 1 librados: starting objecter 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.958+0000 7fec7ab24640 1 Processor -- start 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.958+0000 7fec7ab24640 1 -- start start 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.958+0000 7fec7ab24640 1 librados: setting wanted keys 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.958+0000 7fec7ab24640 1 librados: calling monclient init 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.958+0000 7fec7ab24640 10 monclient: init 2024-04-15T14:59:55.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:55.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:55.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 10 monclient(hunting): picked mon.noname-c con 0x7fec740b57d0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:55.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 10 monclient(hunting): picked mon.noname-a con 0x7fec740b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:55.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 10 monclient(hunting): picked mon.noname-b con 0x7fec74140b30 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:55.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec740ae020 con 0x7fec740b5bb0 2024-04-15T14:59:55.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec741dc1d0 con 0x7fec74140b30 2024-04-15T14:59:55.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec741d8710 con 0x7fec740b57d0 2024-04-15T14:59:55.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:55.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.959+0000 7fec7ab24640 10 monclient(hunting): authenticate will time out at 1456.230883s 2024-04-15T14:59:55.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.989+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f9b300531e0 con 0x7f9b3c031e10 2024-04-15T14:59:55.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.989+0000 7f9b2ffff640 10 client.54284.objecter ms_dispatch 0x7f9b44000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:55.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.989+0000 7f9b2ffff640 3 client.54284.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:55.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.989+0000 7f9b2ffff640 3 client.54284.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:55.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.989+0000 7f9b2ffff640 20 client.54284.objecter dump_active .. 0 homeless 2024-04-15T14:59:55.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.989+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f9b300555e0 con 0x7f9b3c031e10 2024-04-15T14:59:55.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.989+0000 7f9b2ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:55.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.989+0000 7f9b2ffff640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:55.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.995+0000 7f480c933640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f4808146d70 0x7f48081d8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45972/0 (socket says 172.21.15.38:45972) 2024-04-15T14:59:55.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.995+0000 7f480c933640 1 -- 172.21.15.38:0/4202834977 learned_addr learned my addr 172.21.15.38:0/4202834977 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:55.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.996+0000 7f4804ff9640 10 client.?.objecter ms_handle_connect 0x7f4808146d70 2024-04-15T14:59:55.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.996+0000 7f4804ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:55.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.997+0000 7fec788c0640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fec740b57d0 0x7fec741db500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45986/0 (socket says 172.21.15.38:45986) 2024-04-15T14:59:55.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.997+0000 7fec788c0640 1 -- 172.21.15.38:0/924310656 learned_addr learned my addr 172.21.15.38:0/924310656 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:56.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.998+0000 7fec717fa640 10 client.?.objecter ms_handle_connect 0x7fec740b57d0 2024-04-15T14:59:56.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:55.998+0000 7fec717fa640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:56.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.000+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fd9980557e0 con 0x7fd9a0030660 2024-04-15T14:59:56.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.000+0000 7fd99e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.000+0000 7fd99e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:56.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.002+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538544075 0 0) 0x7f480813daa0 con 0x7f4808146d70 2024-04-15T14:59:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.002+0000 7f4804ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:59:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.002+0000 7f4804ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.002+0000 7f4804ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.002+0000 7f4804ff9640 10 monclient(hunting): my global_id is 54290 2024-04-15T14:59:56.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.002+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f4004eb0 con 0x7f4808146d70 2024-04-15T14:59:56.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.004+0000 7f4804ff9640 10 client.?.objecter ms_handle_connect 0x7f48080b5b90 2024-04-15T14:59:56.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.004+0000 7f4804ff9640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:56.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.006+0000 7fec717fa640 10 client.?.objecter ms_handle_connect 0x7fec740b5bb0 2024-04-15T14:59:56.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.006+0000 7fec717fa640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.011+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668361663 0 0) 0x7f480813d4b0 con 0x7f48080b5b90 2024-04-15T14:59:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.011+0000 7f4804ff9640 10 monclient(hunting): _negotiate 2024-04-15T14:59:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.011+0000 7f4804ff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.011+0000 7f4804ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.011+0000 7f4804ff9640 10 monclient(hunting): my global_id is 4395 2024-04-15T14:59:56.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.011+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f480813daa0 con 0x7f48080b5b90 2024-04-15T14:59:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.012+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1782903046 0 0) 0x7fec740ae020 con 0x7fec740b5bb0 2024-04-15T14:59:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.012+0000 7fec717fa640 10 monclient(hunting): _negotiate 2024-04-15T14:59:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.012+0000 7fec717fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.012+0000 7fec717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.012+0000 7fec717fa640 10 monclient(hunting): my global_id is 4398 2024-04-15T14:59:56.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.012+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec58004eb0 con 0x7fec740b5bb0 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.013+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1882488498 0 0) 0x7f47f4004eb0 con 0x7f4808146d70 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.013+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f480813d4b0 con 0x7f4808146d70 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.013+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f4800001fc0 con 0x7f4808146d70 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.013+0000 7f4804ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.013+0000 7f4804ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.013+0000 7f4804ff9640 10 monclient(hunting): dump: 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:56.016 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.013+0000 7f4804ff9640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.014+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439618517 0 0) 0x7fec741d8710 con 0x7fec740b57d0 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.014+0000 7fec717fa640 10 monclient(hunting): _negotiate 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.014+0000 7fec717fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.014+0000 7fec717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.014+0000 7fec717fa640 10 monclient(hunting): my global_id is 54293 2024-04-15T14:59:56.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.014+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec740ae020 con 0x7fec740b57d0 2024-04-15T14:59:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.025+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1712136149 0 0) 0x7fec58004eb0 con 0x7fec740b5bb0 2024-04-15T14:59:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec741d8710 con 0x7fec740b5bb0 2024-04-15T14:59:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec60001bc0 con 0x7fec740b5bb0 2024-04-15T14:59:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 10 monclient(hunting): dump: 2024-04-15T14:59:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:56.028 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:56.029 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:56.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3573169715 0 0) 0x7f480813daa0 con 0x7f48080b5b90 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47f4004eb0 con 0x7f48080b5b90 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f47fc0017e0 con 0x7f48080b5b90 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7f4804ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7f4804ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7f4804ff9640 10 monclient(hunting): dump: 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:56.030 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:56.031 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 949457015 0 0) 0x7fec740ae020 con 0x7fec740b57d0 2024-04-15T14:59:56.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec58004eb0 con 0x7fec740b57d0 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec680018e0 con 0x7fec740b57d0 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.026+0000 7fec717fa640 10 monclient(hunting): dump: 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:56.032 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:56.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 661931509 0 0) 0x7f47f4004eb0 con 0x7f48080b5b90 2024-04-15T14:59:56.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 >> v1:172.21.15.38:6790/0 conn(0x7f4808146d70 legacy=0x7f48081d8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 >> v1:172.21.15.164:6789/0 conn(0x7f48080b57b0 legacy=0x7f480813b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 10 monclient: _finish_hunting 0 2024-04-15T14:59:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 1 monclient: found mon.a 2024-04-15T14:59:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480813ade0 con 0x7f48080b5b90 2024-04-15T14:59:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 10 monclient: _finish_auth 0 2024-04-15T14:59:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 10 monclient: _check_auth_tickets 2024-04-15T14:59:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f4804ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2630407980 0 0) 0x7fec741d8710 con 0x7fec740b5bb0 2024-04-15T14:59:56.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 >> v1:172.21.15.38:6790/0 conn(0x7fec740b57d0 legacy=0x7fec741db500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 >> v1:172.21.15.164:6789/0 conn(0x7fec74140b30 legacy=0x7fec740b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 10 monclient: _finish_hunting 0 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 1 monclient: found mon.a 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec741d88e0 con 0x7fec740b5bb0 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 10 monclient: _finish_auth 0 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 10 monclient: _check_auth_tickets 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec7ab24640 5 monclient: authenticate success, global_id 4398 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec7ab24640 10 monclient: _renew_subs 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec7ab24640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fec74143170 con 0x7fec740b5bb0 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec7ab24640 10 client.4398.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:56.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec7ab24640 10 monclient: _renew_subs 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec7ab24640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fec740b1fc0 con 0x7fec740b5bb0 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7fec7ab24640 1 librados: init done 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f480e396640 5 monclient: authenticate success, global_id 4395 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f480e396640 10 monclient: _renew_subs 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f480e396640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48081e4080 con 0x7f48080b5b90 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f480e396640 10 client.4395.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f480e396640 10 monclient: _renew_subs 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f480e396640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f48081e4430 con 0x7f48080b5b90 2024-04-15T14:59:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.036+0000 7f480e396640 1 librados: init done 2024-04-15T14:59:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.037+0000 7fec7ab24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.037+0000 7fec7ab24640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.037+0000 7fec7ab24640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.037+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec74077050 con 0x7fec740b5bb0 2024-04-15T14:59:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.037+0000 7f480e396640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.037+0000 7f480e396640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.037+0000 7f480e396640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.037+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48080b6890 con 0x7f48080b5b90 2024-04-15T14:59:56.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.114+0000 7febf040d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-15T14:59:56.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.114+0000 7febf040d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-15T14:59:56.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.114+0000 7febf040d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:56.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.114+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7febe8077050 con 0x7febe8146d70 2024-04-15T14:59:56.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.193+0000 7f9b49ae4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-15T14:59:56.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.193+0000 7f9b49ae4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-15T14:59:56.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.193+0000 7f9b49ae4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:56.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.193+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9b3c004cd0 con 0x7f9b3c031e10 2024-04-15T14:59:56.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.203+0000 7f9b2ffff640 1 -- 172.21.15.38:0/2231259611 <== mon.2 v1:172.21.15.38:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 335579355) 0x7f9b30054ee0 con 0x7f9b3c031e10 2024-04-15T14:59:56.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.203+0000 7f9b2ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-15T14:59:56.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.203+0000 7f9b2ffff640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:56.205 INFO:teuthology.orchestra.run.smithi038.stdout:68719476741 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 10 librados: watch_flush enter 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 10 librados: watch_flush exit 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 20 client.54284.objecter shutdown clearing up homeless session... 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 10 client.54284.objecter successfully canceled tick 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 >> v1:172.21.15.38:6800/1608957829 conn(0x7f9b2806f090 legacy=0x7f9b28071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 10 monclient: shutdown 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 >> v1:172.21.15.38:6790/0 conn(0x7f9b3c031e10 legacy=0x7f9b3c02da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 shutdown_connections 2024-04-15T14:59:56.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.206+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 >> 172.21.15.38:0/2231259611 conn(0x7f9b3c0058f0 msgr2=0x7f9b3c0c3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:56.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.207+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 shutdown_connections 2024-04-15T14:59:56.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.207+0000 7f9b49ae4640 1 -- 172.21.15.38:0/2231259611 wait complete. 2024-04-15T14:59:56.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.207+0000 7f9b49ae4640 1 librados: shutdown 2024-04-15T14:59:56.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.209+0000 7fd9b0043640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-15T14:59:56.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.209+0000 7fd9b0043640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-15T14:59:56.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.209+0000 7fd9b0043640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.209+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd9a00c8460 con 0x7fd9a0030660 2024-04-15T14:59:56.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.0 2024-04-15T14:59:56.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.322+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec60001870 con 0x7fec740b5bb0 2024-04-15T14:59:56.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.322+0000 7fec717fa640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:56.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.322+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec60004dd0 con 0x7fec740b5bb0 2024-04-15T14:59:56.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.322+0000 7fec717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:56.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.322+0000 7fec717fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:56.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.322+0000 7fec717fa640 10 monclient: dump: 2024-04-15T14:59:56.324 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:56.324 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:56.324 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.325 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.325 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:56.325 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:56.325 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:56.325 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:56.325 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:56.325 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:56.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.322+0000 7fec72ffd640 4 set_mon_vals no callback set 2024-04-15T14:59:56.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.323+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fec6001b300 con 0x7fec740b5bb0 2024-04-15T14:59:56.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.323+0000 7fec788c0640 10 monclient: get_auth_request con 0x7fec5806edc0 auth_method 0 2024-04-15T14:59:56.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.324+0000 7fec717fa640 10 client.4398.objecter ms_handle_connect 0x7fec5806edc0 2024-04-15T14:59:56.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.330+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fec60053460 con 0x7fec740b5bb0 2024-04-15T14:59:56.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.330+0000 7fec717fa640 10 client.4398.objecter ms_dispatch 0x7fec74000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:56.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.330+0000 7fec717fa640 3 client.4398.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:56.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.330+0000 7fec717fa640 3 client.4398.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:56.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.330+0000 7fec717fa640 20 client.4398.objecter dump_active .. 0 homeless 2024-04-15T14:59:56.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.330+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fec60055860 con 0x7fec740b5bb0 2024-04-15T14:59:56.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.330+0000 7fec717fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.330+0000 7fec717fa640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.438+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe5dc001cf0 con 0x7fe5f40b57b0 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.438+0000 7fe5eaffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.438+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe5dc003a40 con 0x7fe5f40b57b0 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.438+0000 7fe5eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.438+0000 7fe5eaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.438+0000 7fe5eaffd640 10 monclient: dump: 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:56.441 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:56.442 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.438+0000 7fe5f159a640 4 set_mon_vals no callback set 2024-04-15T14:59:56.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.440+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fe5dc019f70 con 0x7fe5f40b57b0 2024-04-15T14:59:56.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.440+0000 7fe5ebfff640 10 monclient: get_auth_request con 0x7fe5d406ee10 auth_method 0 2024-04-15T14:59:56.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.440+0000 7fe5eaffd640 10 client.4372.objecter ms_handle_connect 0x7fe5d406ee10 2024-04-15T14:59:56.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.444+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fe5dc052370 con 0x7fe5f40b57b0 2024-04-15T14:59:56.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.444+0000 7fe5eaffd640 10 client.4372.objecter ms_dispatch 0x7fe5f4000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:56.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.444+0000 7fe5eaffd640 3 client.4372.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:56.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.444+0000 7fe5eaffd640 3 client.4372.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:56.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.445+0000 7fe5eaffd640 20 client.4372.objecter dump_active .. 0 homeless 2024-04-15T14:59:56.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.447+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fe5dc054770 con 0x7fe5f40b57b0 2024-04-15T14:59:56.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.447+0000 7fe5eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.447+0000 7fe5eaffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.455+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14300018e0 con 0x7f1434030660 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.455+0000 7f14237fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.455+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f1430004c30 con 0x7f1434030660 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.455+0000 7f14237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.455+0000 7f14237fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.455+0000 7f14237fe640 10 monclient: dump: 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:56.458 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:56.459 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.455+0000 7f14397fa640 4 set_mon_vals no callback set 2024-04-15T14:59:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.457+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f1430004dd0 con 0x7f1434030660 2024-04-15T14:59:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.457+0000 7f143a7fc640 10 monclient: get_auth_request con 0x7f142806eda0 auth_method 0 2024-04-15T14:59:56.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.458+0000 7f14237fe640 10 client.4375.objecter ms_handle_connect 0x7f142806eda0 2024-04-15T14:59:56.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.458+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f14300533d0 con 0x7f1434030660 2024-04-15T14:59:56.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.458+0000 7f14237fe640 10 client.4375.objecter ms_dispatch 0x7f143c000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:56.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.458+0000 7f14237fe640 3 client.4375.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:56.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.458+0000 7f14237fe640 3 client.4375.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:56.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.458+0000 7f14237fe640 20 client.4375.objecter dump_active .. 0 homeless 2024-04-15T14:59:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.460+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f14300557d0 con 0x7f1434030660 2024-04-15T14:59:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.460+0000 7f14237fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.460+0000 7f14237fe640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:56.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.529+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47fc001cf0 con 0x7f48080b5b90 2024-04-15T14:59:56.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.529+0000 7f4804ff9640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:56.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.529+0000 7f48067fc640 4 set_mon_vals no callback set 2024-04-15T14:59:56.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.538+0000 7fec7ab24640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-15T14:59:56.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.538+0000 7fec7ab24640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-15T14:59:56.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.538+0000 7fec7ab24640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.538+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fec74075f00 con 0x7fec740b5bb0 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.617+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f47fc004a00 con 0x7f48080b5b90 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.617+0000 7f4804ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.617+0000 7f4804ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.617+0000 7f4804ff9640 10 monclient: dump: 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:56.619 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:56.620 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.617+0000 7fec717fa640 1 -- 172.21.15.38:0/924310656 <== mon.0 v1:172.21.15.38:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 2597879969) 0x7fec60055160 con 0x7fec740b5bb0 2024-04-15T14:59:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.617+0000 7fec717fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-15T14:59:56.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.617+0000 7fec717fa640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:56.621 INFO:teuthology.orchestra.run.smithi038.stdout:98784247814 2024-04-15T14:59:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.617+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f47fc004c20 con 0x7f48080b5b90 2024-04-15T14:59:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.618+0000 7f4807fff640 10 monclient: get_auth_request con 0x7f47f406ed30 auth_method 0 2024-04-15T14:59:56.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7f4804ff9640 10 client.4395.objecter ms_handle_connect 0x7f47f406ed30 2024-04-15T14:59:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 10 librados: watch_flush enter 2024-04-15T14:59:56.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 10 librados: watch_flush exit 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 20 client.4398.objecter shutdown clearing up homeless session... 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 10 client.4398.objecter successfully canceled tick 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 >> v1:172.21.15.38:6800/1608957829 conn(0x7fec5806edc0 legacy=0x7fec58071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 10 monclient: shutdown 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 >> v1:172.21.15.38:6789/0 conn(0x7fec740b5bb0 legacy=0x7fec741d8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 shutdown_connections 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.619+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 >> 172.21.15.38:0/924310656 conn(0x7fec74067790 msgr2=0x7fec74146830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.620+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 shutdown_connections 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.620+0000 7fec7ab24640 1 -- 172.21.15.38:0/924310656 wait complete. 2024-04-15T14:59:56.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.620+0000 7fec7ab24640 1 librados: shutdown 2024-04-15T14:59:56.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.624+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f47fc005620 con 0x7f48080b5b90 2024-04-15T14:59:56.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.624+0000 7f4804ff9640 10 client.4395.objecter ms_dispatch 0x7f4808000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:56.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.624+0000 7f4804ff9640 3 client.4395.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:56.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.624+0000 7f4804ff9640 3 client.4395.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:56.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.624+0000 7f4804ff9640 20 client.4395.objecter dump_active .. 0 homeless 2024-04-15T14:59:56.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.624+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f47fc0557e0 con 0x7f48080b5b90 2024-04-15T14:59:56.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.625+0000 7f4804ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.625+0000 7f4804ff9640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:56.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247816 got 98784247814 for osd.3 2024-04-15T14:59:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.657+0000 7f143bfff640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-15T14:59:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.657+0000 7f143bfff640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-15T14:59:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.657+0000 7f143bfff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.657+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f143402fd60 con 0x7f1434030660 2024-04-15T14:59:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.670+0000 7fe5f8fc5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-15T14:59:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.670+0000 7fe5f8fc5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-15T14:59:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.670+0000 7fe5f8fc5640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:56.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.670+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe5f4144240 con 0x7fe5f40b57b0 2024-04-15T14:59:56.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.675+0000 7fd99e7fc640 1 -- 172.21.15.38:0/1543406849 <== mon.0 v1:172.21.15.38:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 3427191320) 0x7fd9980550e0 con 0x7fd9a0030660 2024-04-15T14:59:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.675+0000 7fd99e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-15T14:59:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.675+0000 7fd99e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:56.677 INFO:teuthology.orchestra.run.smithi038.stdout:55834574855 2024-04-15T14:59:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 10 librados: watch_flush enter 2024-04-15T14:59:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 10 librados: watch_flush exit 2024-04-15T14:59:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 20 client.4380.objecter shutdown clearing up homeless session... 2024-04-15T14:59:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 10 client.4380.objecter successfully canceled tick 2024-04-15T14:59:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 >> v1:172.21.15.38:6800/1608957829 conn(0x7fd98c06ee60 legacy=0x7fd98c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 10 monclient: shutdown 2024-04-15T14:59:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 >> v1:172.21.15.38:6789/0 conn(0x7fd9a0030660 legacy=0x7fd9a01605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 shutdown_connections 2024-04-15T14:59:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 >> 172.21.15.38:0/1543406849 conn(0x7fd9a0005c00 msgr2=0x7fd9a0034920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 shutdown_connections 2024-04-15T14:59:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 1 -- 172.21.15.38:0/1543406849 wait complete. 2024-04-15T14:59:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.677+0000 7fd9b0043640 1 librados: shutdown 2024-04-15T14:59:56.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.714+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5e4001900 con 0x7fd5f013ff00 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.714+0000 7fd5ecff9640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.714+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fd5e4001c50 con 0x7fd5f013ff00 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.714+0000 7fd5ecff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.714+0000 7fd5ecff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.714+0000 7fd5ecff9640 10 monclient: dump: 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:56.718 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.714+0000 7fd5ee7fc640 4 set_mon_vals no callback set 2024-04-15T14:59:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.715+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fd5e401b1e0 con 0x7fd5f013ff00 2024-04-15T14:59:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.716+0000 7fd5effff640 10 monclient: get_auth_request con 0x7fd5dc06ed80 auth_method 0 2024-04-15T14:59:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.716+0000 7fd5ecff9640 10 client.4366.objecter ms_handle_connect 0x7fd5dc06ed80 2024-04-15T14:59:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.721+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fd5e4053410 con 0x7fd5f013ff00 2024-04-15T14:59:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.721+0000 7fd5ecff9640 10 client.4366.objecter ms_dispatch 0x7fd5f0000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.721+0000 7fd5ecff9640 3 client.4366.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.721+0000 7fd5ecff9640 3 client.4366.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.721+0000 7fd5ecff9640 20 client.4366.objecter dump_active .. 0 homeless 2024-04-15T14:59:56.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.723+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fd5e4055810 con 0x7fd5f013ff00 2024-04-15T14:59:56.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.723+0000 7fd5ecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:56.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.723+0000 7fd5ecff9640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:56.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.743+0000 7febdeffd640 1 -- 172.21.15.38:0/182853014 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 762516608) 0x7febe00546a0 con 0x7febe8146d70 2024-04-15T14:59:56.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.743+0000 7febdeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-15T14:59:56.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.743+0000 7febdeffd640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:56.745 INFO:teuthology.orchestra.run.smithi038.stdout:85899345926 2024-04-15T14:59:56.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.743+0000 7f14237fe640 1 -- 172.21.15.38:0/3111291864 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1840568361) 0x7f14300550d0 con 0x7f1434030660 2024-04-15T14:59:56.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.743+0000 7f14237fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-15T14:59:56.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.743+0000 7f14237fe640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:56.746 INFO:teuthology.orchestra.run.smithi038.stdout:90194313222 2024-04-15T14:59:56.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.743+0000 7fe5eaffd640 1 -- 172.21.15.38:0/121780642 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 335579355) 0x7fe5dc054070 con 0x7fe5f40b57b0 2024-04-15T14:59:56.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.743+0000 7fe5eaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-15T14:59:56.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.743+0000 7fe5eaffd640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:56.747 INFO:teuthology.orchestra.run.smithi038.stdout:68719476741 2024-04-15T14:59:56.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 10 librados: watch_flush enter 2024-04-15T14:59:56.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 10 librados: watch_flush exit 2024-04-15T14:59:56.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 20 client.4354.objecter shutdown clearing up homeless session... 2024-04-15T14:59:56.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 10 client.4354.objecter successfully canceled tick 2024-04-15T14:59:56.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 >> v1:172.21.15.38:6800/1608957829 conn(0x7febcc06eed0 legacy=0x7febcc071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 10 monclient: shutdown 2024-04-15T14:59:56.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:56.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 >> v1:172.21.15.164:6789/0 conn(0x7febe8146d70 legacy=0x7febe81e8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7f143bfff640 10 librados: watch_flush enter 2024-04-15T14:59:56.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7f143bfff640 10 librados: watch_flush exit 2024-04-15T14:59:56.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7f143bfff640 20 client.4375.objecter shutdown clearing up homeless session... 2024-04-15T14:59:56.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7f143bfff640 10 client.4375.objecter successfully canceled tick 2024-04-15T14:59:56.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 shutdown_connections 2024-04-15T14:59:56.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 >> 172.21.15.38:0/182853014 conn(0x7febe8067790 msgr2=0x7febe80b7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:56.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 >> v1:172.21.15.38:6800/1608957829 conn(0x7f142806eda0 legacy=0x7f1428071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7f143bfff640 10 monclient: shutdown 2024-04-15T14:59:56.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7f143bfff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:56.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 >> v1:172.21.15.164:6789/0 conn(0x7f1434030660 legacy=0x7f14340c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.746+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 shutdown_connections 2024-04-15T14:59:56.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7febf040d640 1 -- 172.21.15.38:0/182853014 wait complete. 2024-04-15T14:59:56.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7febf040d640 1 librados: shutdown 2024-04-15T14:59:56.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 10 librados: watch_flush enter 2024-04-15T14:59:56.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 10 librados: watch_flush exit 2024-04-15T14:59:56.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 20 client.4372.objecter shutdown clearing up homeless session... 2024-04-15T14:59:56.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 10 client.4372.objecter successfully canceled tick 2024-04-15T14:59:56.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 >> v1:172.21.15.38:6800/1608957829 conn(0x7fe5d406ee10 legacy=0x7fe5d40712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 10 monclient: shutdown 2024-04-15T14:59:56.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:56.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 >> v1:172.21.15.164:6789/0 conn(0x7fe5f40b57b0 legacy=0x7fe5f41365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 shutdown_connections 2024-04-15T14:59:56.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 >> 172.21.15.38:0/3111291864 conn(0x7f1434005c00 msgr2=0x7f1434034090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:56.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 shutdown_connections 2024-04-15T14:59:56.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 >> 172.21.15.38:0/121780642 conn(0x7fe5f4067790 msgr2=0x7fe5f413fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:56.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 shutdown_connections 2024-04-15T14:59:56.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 shutdown_connections 2024-04-15T14:59:56.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7f143bfff640 1 -- 172.21.15.38:0/3111291864 wait complete. 2024-04-15T14:59:56.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 1 -- 172.21.15.38:0/121780642 wait complete. 2024-04-15T14:59:56.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7fe5f8fc5640 1 librados: shutdown 2024-04-15T14:59:56.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.747+0000 7f143bfff640 1 librados: shutdown 2024-04-15T14:59:56.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313223 got 90194313222 for osd.5 2024-04-15T14:59:56.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.1 2024-04-15T14:59:56.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 85899345927 got 85899345926 for osd.4 2024-04-15T14:59:56.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.844+0000 7f480e396640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-15T14:59:56.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.844+0000 7f480e396640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-15T14:59:56.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.844+0000 7f480e396640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:56.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.844+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f480813c440 con 0x7f48080b5b90 2024-04-15T14:59:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.858+0000 7f4804ff9640 1 -- 172.21.15.38:0/4202834977 <== mon.0 v1:172.21.15.38:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (unknown 92182286 0 1977379961) 0x7f480813c440 con 0x7f48080b5b90 2024-04-15T14:59:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.858+0000 7f4804ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-15T14:59:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.858+0000 7f4804ff9640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:56.860 INFO:teuthology.orchestra.run.smithi038.stdout:103079215111 2024-04-15T14:59:56.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 10 librados: watch_flush enter 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 10 librados: watch_flush exit 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 20 client.4395.objecter shutdown clearing up homeless session... 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 10 client.4395.objecter successfully canceled tick 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 >> v1:172.21.15.38:6800/1608957829 conn(0x7f47f406ed30 legacy=0x7f47f40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 10 monclient: shutdown 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 >> v1:172.21.15.38:6789/0 conn(0x7f48080b5b90 legacy=0x7f48081d8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 shutdown_connections 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 >> 172.21.15.38:0/4202834977 conn(0x7f4808067790 msgr2=0x7f48080b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 shutdown_connections 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 1 -- 172.21.15.38:0/4202834977 wait complete. 2024-04-15T14:59:56.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.860+0000 7f480e396640 1 librados: shutdown 2024-04-15T14:59:56.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215112 got 103079215111 for osd.2 2024-04-15T14:59:56.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.934+0000 7fd5f65fb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2024-04-15T14:59:56.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.934+0000 7fd5f65fb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-04-15T14:59:56.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.934+0000 7fd5f65fb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:56.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.934+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd5f00700b0 con 0x7fd5f013ff00 2024-04-15T14:59:56.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.985+0000 7fd5ecff9640 1 -- 172.21.15.38:0/222257339 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 591313397) 0x7fd5e4055110 con 0x7fd5f013ff00 2024-04-15T14:59:56.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.986+0000 7fd5ecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-04-15T14:59:56.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.986+0000 7fd5ecff9640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:56.988 INFO:teuthology.orchestra.run.smithi038.stdout:90194313226 2024-04-15T14:59:56.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.987+0000 7fd5f65fb640 10 librados: watch_flush enter 2024-04-15T14:59:56.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.987+0000 7fd5f65fb640 10 librados: watch_flush exit 2024-04-15T14:59:56.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 20 client.4366.objecter shutdown clearing up homeless session... 2024-04-15T14:59:56.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 10 client.4366.objecter successfully canceled tick 2024-04-15T14:59:56.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 >> v1:172.21.15.38:6800/1608957829 conn(0x7fd5dc06ed80 legacy=0x7fd5dc071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 10 monclient: shutdown 2024-04-15T14:59:56.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:56.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 >> v1:172.21.15.164:6789/0 conn(0x7fd5f013ff00 legacy=0x7fd5f01e7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:56.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 shutdown_connections 2024-04-15T14:59:56.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 >> 172.21.15.38:0/222257339 conn(0x7fd5f0068140 msgr2=0x7fd5f00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:56.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 shutdown_connections 2024-04-15T14:59:56.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 1 -- 172.21.15.38:0/222257339 wait complete. 2024-04-15T14:59:56.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:56.988+0000 7fd5f65fb640 1 librados: shutdown 2024-04-15T14:59:57.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313226 got 90194313226 for osd.7 2024-04-15T14:59:57.003 DEBUG:teuthology.parallel:result is None 2024-04-15T14:59:57.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T14:59:57.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.325+0000 7fc401cf8640 10 monclient: get_monmap_and_config 2024-04-15T14:59:57.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.325+0000 7fc401cf8640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.325+0000 7fc401cf8640 10 monclient: monmap: 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:57.326398+0000 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:57.326398+0000 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:57.327 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.325+0000 7fc401cf8640 1 Processor -- start 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.325+0000 7fc401cf8640 1 -- start start 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.325+0000 7fc401cf8640 10 monclient: init 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 10 monclient(hunting): picked mon.noname-b con 0x7fc3fc075640 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 10 monclient(hunting): picked mon.noname-c con 0x7fc3fc140a10 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 10 monclient(hunting): picked mon.noname-a con 0x7fc3fc146f10 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc0706a0 con 0x7fc3fc146f10 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc0b18c0 con 0x7fc3fc140a10 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc06f7d0 con 0x7fc3fc075640 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc401cf8640 10 monclient(hunting): authenticate will time out at 1457.597530s 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc3fb7fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fc3fc075640 0x7fc3fc140300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:45994/0 (socket says 172.21.15.38:45994) 2024-04-15T14:59:57.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.326+0000 7fc3fb7fe640 1 -- 172.21.15.38:0/2258797514 learned_addr learned my addr 172.21.15.38:0/2258797514 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1973511995 0 0) 0x7fc3fc06f7d0 con 0x7fc3fc075640 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): my global_id is 54296 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e4003520 con 0x7fc3fc075640 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95967989 0 0) 0x7fc3fc0706a0 con 0x7fc3fc146f10 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): my global_id is 4401 2024-04-15T14:59:57.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3fc06f7d0 con 0x7fc3fc146f10 2024-04-15T14:59:57.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 765404099 0 0) 0x7fc3fc0b18c0 con 0x7fc3fc140a10 2024-04-15T14:59:57.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 10 monclient(hunting): my global_id is 4381 2024-04-15T14:59:57.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.329+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3fc0706a0 con 0x7fc3fc140a10 2024-04-15T14:59:57.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1188753219 0 0) 0x7fc3e4003520 con 0x7fc3fc075640 2024-04-15T14:59:57.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 >> v1:172.21.15.164:6789/0 conn(0x7fc3fc140a10 legacy=0x7fc3fc146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 >> v1:172.21.15.38:6789/0 conn(0x7fc3fc146f10 legacy=0x7fc3fc14ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:57.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 1 monclient: found mon.noname-b 2024-04-15T14:59:57.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:57.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T14:59:57.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc1473a0 con 0x7fc3fc075640 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc401cf8640 5 monclient: authenticate success, global_id 54296 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc401cf8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc3ec001610 con 0x7fc3fc075640 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc3fa7fc640 10 monclient: dump: 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.335 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.336 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.336 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.336 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.336 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.336 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.336 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.332+0000 7fc401cf8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:57.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3ec0018a0 con 0x7fc3fc075640 2024-04-15T14:59:57.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc3fa7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc3fa7fc640 1 -- 172.21.15.38:0/2258797514 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc3ec001c70 con 0x7fc3fc075640 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc401cf8640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc401cf8640 4 set_mon_vals no callback set 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc3fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc3fa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc3fa7fc640 10 monclient: dump: 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.338 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc401cf8640 10 monclient: shutdown 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc401cf8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc401cf8640 1 -- 172.21.15.38:0/2258797514 >> v1:172.21.15.38:6790/0 conn(0x7fc3fc075640 legacy=0x7fc3fc140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc401cf8640 1 -- 172.21.15.38:0/2258797514 shutdown_connections 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc401cf8640 1 -- 172.21.15.38:0/2258797514 >> 172.21.15.38:0/2258797514 conn(0x7fc3fc0b54c0 msgr2=0x7fc3fc0b58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:57.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc401cf8640 1 -- 172.21.15.38:0/2258797514 shutdown_connections 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.334+0000 7fc401cf8640 1 -- 172.21.15.38:0/2258797514 wait complete. 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.335+0000 7fc401cf8640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.335+0000 7fc401cf8640 10 monclient: monmap: 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:57.340 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:57.341 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.335+0000 7fc401cf8640 1 librados: starting msgr at 2024-04-15T14:59:57.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.335+0000 7fc401cf8640 1 librados: starting objecter 2024-04-15T14:59:57.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.335+0000 7fc401cf8640 1 Processor -- start 2024-04-15T14:59:57.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 1 -- start start 2024-04-15T14:59:57.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 1 librados: setting wanted keys 2024-04-15T14:59:57.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 1 librados: calling monclient init 2024-04-15T14:59:57.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 10 monclient: init 2024-04-15T14:59:57.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 10 monclient(hunting): picked mon.noname-c con 0x7fc3fc075640 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 10 monclient(hunting): picked mon.noname-b con 0x7fc3fc140a10 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 10 monclient(hunting): picked mon.noname-a con 0x7fc3fc146f10 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc11d850 con 0x7fc3fc146f10 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc11e780 con 0x7fc3fc140a10 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3fc1dbb40 con 0x7fc3fc075640 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc401cf8640 10 monclient(hunting): authenticate will time out at 1457.608057s 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.336+0000 7fc3fb7fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fc3fc075640 0x7fc3fc11d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46000/0 (socket says 172.21.15.38:46000) 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.337+0000 7fc3fb7fe640 1 -- 172.21.15.38:0/59381223 learned_addr learned my addr 172.21.15.38:0/59381223 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.337+0000 7fc3e3fff640 10 client.?.objecter ms_handle_connect 0x7fc3fc075640 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.337+0000 7fc3e3fff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.337+0000 7fc3e3fff640 10 client.?.objecter ms_handle_connect 0x7fc3fc146f10 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.337+0000 7fc3e3fff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.337+0000 7fc3e3fff640 10 client.?.objecter ms_handle_connect 0x7fc3fc140a10 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.337+0000 7fc3e3fff640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2315527543 0 0) 0x7fc3fc1dbb40 con 0x7fc3fc075640 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): my global_id is 54299 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e8004eb0 con 0x7fc3fc075640 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960040369 0 0) 0x7fc3fc11e780 con 0x7fc3fc140a10 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): my global_id is 4384 2024-04-15T14:59:57.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3fc1dbb40 con 0x7fc3fc140a10 2024-04-15T14:59:57.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225342473 0 0) 0x7fc3fc11d850 con 0x7fc3fc146f10 2024-04-15T14:59:57.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 10 monclient(hunting): my global_id is 4404 2024-04-15T14:59:57.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.339+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3fc11e780 con 0x7fc3fc146f10 2024-04-15T14:59:57.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2354614687 0 0) 0x7fc3fc1dbb40 con 0x7fc3fc140a10 2024-04-15T14:59:57.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3fc11d850 con 0x7fc3fc140a10 2024-04-15T14:59:57.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc3f00018b0 con 0x7fc3fc140a10 2024-04-15T14:59:57.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:57.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:57.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): dump: 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2740440010 0 0) 0x7fc3e8004eb0 con 0x7fc3fc075640 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3fc1dbb40 con 0x7fc3fc075640 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc3ec001bf0 con 0x7fc3fc075640 2024-04-15T14:59:57.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): dump: 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1775216536 0 0) 0x7fc3fc11e780 con 0x7fc3fc146f10 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3e8004eb0 con 0x7fc3fc146f10 2024-04-15T14:59:57.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc3f4001a20 con 0x7fc3fc146f10 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.344+0000 7fc3e3fff640 10 monclient(hunting): dump: 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.350 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2142586467 0 0) 0x7fc3fc11d850 con 0x7fc3fc140a10 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 >> v1:172.21.15.38:6790/0 conn(0x7fc3fc075640 legacy=0x7fc3fc11d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 >> v1:172.21.15.38:6789/0 conn(0x7fc3fc146f10 legacy=0x7fc3fc13b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 1 monclient: found mon.b 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc1dc770 con 0x7fc3fc140a10 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 10 monclient: _finish_auth 0 2024-04-15T14:59:57.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc3e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc401cf8640 5 monclient: authenticate success, global_id 4384 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc401cf8640 10 monclient: _renew_subs 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc401cf8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc13bca0 con 0x7fc3fc140a10 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc401cf8640 10 client.4384.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc401cf8640 10 monclient: _renew_subs 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc401cf8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3fc1410f0 con 0x7fc3fc140a10 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.347+0000 7fc401cf8640 1 librados: init done 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.348+0000 7fc401cf8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.348+0000 7fc401cf8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.348+0000 7fc401cf8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.348+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3fc077050 con 0x7fc3fc140a10 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.349+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3f0003610 con 0x7fc3fc140a10 2024-04-15T14:59:57.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.349+0000 7fc3e3fff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:57.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.349+0000 7fc3f9ffb640 4 set_mon_vals no callback set 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.600+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc3f0003960 con 0x7fc3fc140a10 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.600+0000 7fc3e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.600+0000 7fc3e3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.600+0000 7fc3e3fff640 10 monclient: dump: 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.601 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.602 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.602 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.602 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.602 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.600+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fc3f0019e90 con 0x7fc3fc140a10 2024-04-15T14:59:57.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.600+0000 7fc3fb7fe640 10 monclient: get_auth_request con 0x7fc3e806ee80 auth_method 0 2024-04-15T14:59:57.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.600+0000 7fc3e3fff640 10 client.4384.objecter ms_handle_connect 0x7fc3e806ee80 2024-04-15T14:59:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.601+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fc3f0052160 con 0x7fc3fc140a10 2024-04-15T14:59:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.601+0000 7fc3e3fff640 10 client.4384.objecter ms_dispatch 0x7fc3fc000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.601+0000 7fc3e3fff640 3 client.4384.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.601+0000 7fc3e3fff640 3 client.4384.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:57.604 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.601+0000 7fc3e3fff640 20 client.4384.objecter dump_active .. 0 homeless 2024-04-15T14:59:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.604+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fc3f0054560 con 0x7fc3fc140a10 2024-04-15T14:59:57.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.604+0000 7fc3e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:57.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.604+0000 7fc3e3fff640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:57.638 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-15T14:59:57.690 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-15T14:59:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.746+0000 7f41f4ea6640 10 monclient: get_monmap_and_config 2024-04-15T14:59:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.746+0000 7f41f4ea6640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.746+0000 7f41f4ea6640 10 monclient: monmap: 2024-04-15T14:59:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:57.746981+0000 2024-04-15T14:59:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:57.746981+0000 2024-04-15T14:59:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.747 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:57.748 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.746+0000 7f41f4ea6640 1 Processor -- start 2024-04-15T14:59:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 1 -- start start 2024-04-15T14:59:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 10 monclient: init 2024-04-15T14:59:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 10 monclient(hunting): picked mon.noname-a con 0x7f41f00b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 10 monclient(hunting): picked mon.noname-b con 0x7f41f00b5bb0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 10 monclient(hunting): picked mon.noname-c con 0x7f41f0140b30 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f0146e10 con 0x7f41f00b57d0 2024-04-15T14:59:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f00aa840 con 0x7f41f0140b30 2024-04-15T14:59:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f00aa460 con 0x7f41f00b5bb0 2024-04-15T14:59:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.747+0000 7f41f4ea6640 10 monclient(hunting): authenticate will time out at 1458.018101s 2024-04-15T14:59:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.748+0000 7f41e7fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f41f00b5bb0 0x7f41f0140420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46012/0 (socket says 172.21.15.38:46012) 2024-04-15T14:59:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.748+0000 7f41e7fff640 1 -- 172.21.15.38:0/2392522341 learned_addr learned my addr 172.21.15.38:0/2392522341 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.750+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4263034300 0 0) 0x7f41f00aa840 con 0x7f41f0140b30 2024-04-15T14:59:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.750+0000 7f41edd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.750+0000 7f41edd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.750+0000 7f41edd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.750+0000 7f41edd9b640 10 monclient(hunting): my global_id is 4387 2024-04-15T14:59:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41dc003520 con 0x7f41f0140b30 2024-04-15T14:59:57.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712461544 0 0) 0x7f41f0146e10 con 0x7f41f00b57d0 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 10 monclient(hunting): my global_id is 4407 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f00aa840 con 0x7f41f00b57d0 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 590072919 0 0) 0x7f41f00aa460 con 0x7f41f00b5bb0 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 10 monclient(hunting): my global_id is 54302 2024-04-15T14:59:57.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.751+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f0146e10 con 0x7f41f00b5bb0 2024-04-15T14:59:57.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 776916345 0 0) 0x7f41dc003520 con 0x7f41f0140b30 2024-04-15T14:59:57.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 >> v1:172.21.15.38:6790/0 conn(0x7f41f00b5bb0 legacy=0x7f41f0140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 >> v1:172.21.15.38:6789/0 conn(0x7f41f00b57d0 legacy=0x7f41f0146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 10 monclient: _finish_hunting 0 2024-04-15T14:59:57.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 1 monclient: found mon.noname-c 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f00b2970 con 0x7f41f0140b30 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 10 monclient: _finish_auth 0 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 10 monclient: _check_auth_tickets 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f41e8001990 con 0x7f41f0140b30 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41edd9b640 10 monclient: dump: 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.756 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.757 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.757 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.757 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.757 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.757 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.757 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41f4ea6640 5 monclient: authenticate success, global_id 4387 2024-04-15T14:59:57.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.754+0000 7f41f4ea6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:57.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.756+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41e8001bf0 con 0x7f41f0140b30 2024-04-15T14:59:57.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.756+0000 7f41edd9b640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:57.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.756+0000 7f41edd9b640 1 -- 172.21.15.38:0/2392522341 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f41e8001fc0 con 0x7f41f0140b30 2024-04-15T14:59:57.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.756+0000 7f41f4ea6640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:57.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.756+0000 7f41f4ea6640 4 set_mon_vals no callback set 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.756+0000 7f41edd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.756+0000 7f41edd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.756+0000 7f41edd9b640 10 monclient: dump: 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.757+0000 7f41f4ea6640 10 monclient: shutdown 2024-04-15T14:59:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.757+0000 7f41f4ea6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.757+0000 7f41f4ea6640 1 -- 172.21.15.38:0/2392522341 >> v1:172.21.15.164:6789/0 conn(0x7f41f0140b30 legacy=0x7f41f014ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.757+0000 7f41f4ea6640 1 -- 172.21.15.38:0/2392522341 shutdown_connections 2024-04-15T14:59:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.757+0000 7f41f4ea6640 1 -- 172.21.15.38:0/2392522341 >> 172.21.15.38:0/2392522341 conn(0x7f41f0067790 msgr2=0x7f41f0067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.757+0000 7f41f4ea6640 1 -- 172.21.15.38:0/2392522341 shutdown_connections 2024-04-15T14:59:57.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.757+0000 7f41f4ea6640 1 -- 172.21.15.38:0/2392522341 wait complete. 2024-04-15T14:59:57.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.758+0000 7f41f4ea6640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.758+0000 7f41f4ea6640 10 monclient: monmap: 2024-04-15T14:59:57.761 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.761 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:57.761 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:57.761 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:57.761 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.761 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:57.761 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.758+0000 7f41f4ea6640 1 librados: starting msgr at 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.758+0000 7f41f4ea6640 1 librados: starting objecter 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 1 Processor -- start 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 1 -- start start 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 1 librados: setting wanted keys 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 1 librados: calling monclient init 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 10 monclient: init 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:57.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 10 monclient(hunting): picked mon.noname-a con 0x7f41f00b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 10 monclient(hunting): picked mon.noname-c con 0x7f41f00b5bb0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 10 monclient(hunting): picked mon.noname-b con 0x7f41f0140b30 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f00ad0b0 con 0x7f41f00b57d0 2024-04-15T14:59:57.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f01d8bb0 con 0x7f41f0140b30 2024-04-15T14:59:57.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f00ad850 con 0x7f41f00b5bb0 2024-04-15T14:59:57.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.759+0000 7f41f4ea6640 10 monclient(hunting): authenticate will time out at 1458.030286s 2024-04-15T14:59:57.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.761+0000 7f41eed9d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f41f0140b30 0x7f41f0138ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:37066/0 (socket says 172.21.15.38:37066) 2024-04-15T14:59:57.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.761+0000 7f41eed9d640 1 -- 172.21.15.38:0/3809779732 learned_addr learned my addr 172.21.15.38:0/3809779732 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.761+0000 7f41e6ffd640 10 client.?.objecter ms_handle_connect 0x7f41f0140b30 2024-04-15T14:59:57.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.761+0000 7f41e6ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:57.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.761+0000 7f41e6ffd640 10 client.?.objecter ms_handle_connect 0x7f41f00b5bb0 2024-04-15T14:59:57.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.761+0000 7f41e6ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:57.771 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-15T14:59:57.772 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T14:59:57.772 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-15T14:59:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.781+0000 7f41e6ffd640 10 client.?.objecter ms_handle_connect 0x7f41f00b57d0 2024-04-15T14:59:57.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.781+0000 7f41e6ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:57.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.814+0000 7f8009704640 10 monclient: get_monmap_and_config 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.814+0000 7f8009704640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.814+0000 7f8009704640 10 monclient: monmap: 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:57.815534+0000 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:57.815534+0000 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:57.816 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.815+0000 7f8009704640 1 Processor -- start 2024-04-15T14:59:57.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.815+0000 7f8009704640 1 -- start start 2024-04-15T14:59:57.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.815+0000 7f8009704640 10 monclient: init 2024-04-15T14:59:57.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.816+0000 7f8009704640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.816+0000 7f8009704640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:57.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.816+0000 7f8009704640 10 monclient(hunting): picked mon.noname-b con 0x7f80040b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.817+0000 7f8009704640 10 monclient(hunting): picked mon.noname-c con 0x7f80040b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.817+0000 7f8009704640 10 monclient(hunting): picked mon.noname-a con 0x7f8004146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.817+0000 7f8009704640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8004140ca0 con 0x7f8004146d70 2024-04-15T14:59:57.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.817+0000 7f8009704640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80040ab0e0 con 0x7f80040b5b90 2024-04-15T14:59:57.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.817+0000 7f8009704640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80040b3310 con 0x7f80040b57b0 2024-04-15T14:59:57.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.817+0000 7f8009704640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.817+0000 7f8009704640 10 monclient(hunting): authenticate will time out at 1458.087493s 2024-04-15T14:59:57.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.820+0000 7fc401cf8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-15T14:59:57.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.820+0000 7fc401cf8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-15T14:59:57.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.820+0000 7fc401cf8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.820+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc3fc13be70 con 0x7fc3fc140a10 2024-04-15T14:59:57.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.822+0000 7f80037fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8004146d70 0x7f800414ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55888/0 (socket says 172.21.15.38:55888) 2024-04-15T14:59:57.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.822+0000 7f80037fe640 1 -- 172.21.15.38:0/200746408 learned_addr learned my addr 172.21.15.38:0/200746408 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.832+0000 7fc3e3fff640 1 -- 172.21.15.38:0/59381223 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 860207157) 0x7fc3f0053e60 con 0x7fc3fc140a10 2024-04-15T14:59:57.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.832+0000 7fc3e3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-15T14:59:57.833 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.832+0000 7fc3e3fff640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:57.834 INFO:teuthology.orchestra.run.smithi038.stdout:68719476743 2024-04-15T14:59:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.835+0000 7fc401cf8640 10 librados: watch_flush enter 2024-04-15T14:59:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.835+0000 7fc401cf8640 10 librados: watch_flush exit 2024-04-15T14:59:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.835+0000 7fc401cf8640 20 client.4384.objecter shutdown clearing up homeless session... 2024-04-15T14:59:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.835+0000 7fc401cf8640 10 client.4384.objecter successfully canceled tick 2024-04-15T14:59:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.836+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 >> v1:172.21.15.38:6800/1608957829 conn(0x7fc3e806ee80 legacy=0x7fc3e8071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.836+0000 7fc401cf8640 10 monclient: shutdown 2024-04-15T14:59:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.836+0000 7fc401cf8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.836+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 >> v1:172.21.15.164:6789/0 conn(0x7fc3fc140a10 legacy=0x7fc3fc1dc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.836+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 shutdown_connections 2024-04-15T14:59:57.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.836+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 >> 172.21.15.38:0/59381223 conn(0x7fc3fc0b54c0 msgr2=0x7fc3fc0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:57.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.838+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 shutdown_connections 2024-04-15T14:59:57.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.838+0000 7fc401cf8640 1 -- 172.21.15.38:0/59381223 wait complete. 2024-04-15T14:59:57.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.838+0000 7fc401cf8640 1 librados: shutdown 2024-04-15T14:59:57.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476743 for osd.0 2024-04-15T14:59:57.856 DEBUG:teuthology.parallel:result is None 2024-04-15T14:59:57.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.869+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863926581 0 0) 0x7f41f00ad0b0 con 0x7f41f00b57d0 2024-04-15T14:59:57.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.869+0000 7f41e6ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.869+0000 7f41e6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.869+0000 7f41e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.869+0000 7f41e6ffd640 10 monclient(hunting): my global_id is 4410 2024-04-15T14:59:57.870 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.869+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d0004eb0 con 0x7f41f00b57d0 2024-04-15T14:59:57.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.871+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823556143 0 0) 0x7f8004140ca0 con 0x7f8004146d70 2024-04-15T14:59:57.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.871+0000 7f80027fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.871+0000 7f80027fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.871+0000 7f80027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.871+0000 7f80027fc640 10 monclient(hunting): my global_id is 4413 2024-04-15T14:59:57.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.871+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe4003520 con 0x7f8004146d70 2024-04-15T14:59:57.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233690770 0 0) 0x7f41f01d8bb0 con 0x7f41f0140b30 2024-04-15T14:59:57.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f41e6ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f41e6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f41e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f41e6ffd640 10 monclient(hunting): my global_id is 4390 2024-04-15T14:59:57.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f00ad0b0 con 0x7f41f0140b30 2024-04-15T14:59:57.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T14:59:57.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317417547 0 0) 0x7f80040ab0e0 con 0x7f80040b5b90 2024-04-15T14:59:57.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f80027fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f80027fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f80027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f80027fc640 10 monclient(hunting): my global_id is 4393 2024-04-15T14:59:57.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.873+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8004140ca0 con 0x7f80040b5b90 2024-04-15T14:59:57.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005345025 0 0) 0x7f80040b3310 con 0x7f80040b57b0 2024-04-15T14:59:57.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f80027fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f80027fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f80027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f80027fc640 10 monclient(hunting): my global_id is 54308 2024-04-15T14:59:57.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80040ab0e0 con 0x7f80040b57b0 2024-04-15T14:59:57.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677654315 0 0) 0x7f41f00ad850 con 0x7f41f00b5bb0 2024-04-15T14:59:57.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f41e6ffd640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f41e6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f41e6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f41e6ffd640 10 monclient(hunting): my global_id is 54305 2024-04-15T14:59:57.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.875+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f01d8bb0 con 0x7f41f00b5bb0 2024-04-15T14:59:57.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 192331041 0 0) 0x7f8004140ca0 con 0x7f80040b5b90 2024-04-15T14:59:57.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 >> v1:172.21.15.38:6790/0 conn(0x7f80040b57b0 legacy=0x7f8004140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 >> v1:172.21.15.38:6789/0 conn(0x7f8004146d70 legacy=0x7f800414ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 1 monclient: found mon.noname-c 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80040aa460 con 0x7f80040b5b90 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3594523624 0 0) 0x7f41f00ad0b0 con 0x7f41f0140b30 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41f00ad850 con 0x7f41f0140b30 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f41e8001f40 con 0x7f41f0140b30 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f41e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f41e6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:57.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f41e6ffd640 10 monclient(hunting): dump: 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f41e6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7ff40015f0 con 0x7f80040b5b90 2024-04-15T14:59:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f80027fc640 10 monclient: dump: 2024-04-15T14:59:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.884 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f8009704640 5 monclient: authenticate success, global_id 4393 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.880+0000 7f8009704640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.881+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1869347823 0 0) 0x7f41d0004eb0 con 0x7f41f00b57d0 2024-04-15T14:59:57.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.881+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41f00ad0b0 con 0x7f41f00b57d0 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.881+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f41e00018b0 con 0x7f41f00b57d0 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.881+0000 7f41e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.881+0000 7f41e6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.881+0000 7f41e6ffd640 10 monclient(hunting): dump: 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.886 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2505909054 0 0) 0x7f41f00ad850 con 0x7f41f0140b30 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 >> v1:172.21.15.38:6790/0 conn(0x7f41f00b5bb0 legacy=0x7f41f00ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 >> v1:172.21.15.38:6789/0 conn(0x7f41f00b57d0 legacy=0x7f41f01d9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 10 monclient: _finish_hunting 0 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 1 monclient: found mon.b 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f00ada20 con 0x7f41f0140b30 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 10 monclient: _finish_auth 0 2024-04-15T14:59:57.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 10 monclient: _check_auth_tickets 2024-04-15T14:59:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ff40018c0 con 0x7f80040b5b90 2024-04-15T14:59:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f80027fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f80027fc640 1 -- 172.21.15.38:0/200746408 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7ff4001c90 con 0x7f80040b5b90 2024-04-15T14:59:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f80027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f80027fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f80027fc640 10 monclient: dump: 2024-04-15T14:59:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.888 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.889 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41f4ea6640 5 monclient: authenticate success, global_id 4390 2024-04-15T14:59:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41f4ea6640 10 monclient: _renew_subs 2024-04-15T14:59:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41f4ea6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41f01395e0 con 0x7f41f0140b30 2024-04-15T14:59:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41f4ea6640 10 client.4390.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41f4ea6640 10 monclient: _renew_subs 2024-04-15T14:59:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41f4ea6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f41f01417e0 con 0x7f41f0140b30 2024-04-15T14:59:57.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f41f4ea6640 1 librados: init done 2024-04-15T14:59:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f8009704640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.885+0000 7f8009704640 4 set_mon_vals no callback set 2024-04-15T14:59:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.886+0000 7f8009704640 10 monclient: shutdown 2024-04-15T14:59:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.886+0000 7f8009704640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.886+0000 7f8009704640 1 -- 172.21.15.38:0/200746408 >> v1:172.21.15.164:6789/0 conn(0x7f80040b5b90 legacy=0x7f8004146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.886+0000 7f8009704640 1 -- 172.21.15.38:0/200746408 shutdown_connections 2024-04-15T14:59:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.886+0000 7f8009704640 1 -- 172.21.15.38:0/200746408 >> 172.21.15.38:0/200746408 conn(0x7f8004067790 msgr2=0x7f8004067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.886+0000 7f8009704640 1 -- 172.21.15.38:0/200746408 shutdown_connections 2024-04-15T14:59:57.891 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.886+0000 7f8009704640 1 -- 172.21.15.38:0/200746408 wait complete. 2024-04-15T14:59:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.887+0000 7f41f4ea6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.887+0000 7f41f4ea6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.887+0000 7f41f4ea6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.887+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f00aec70 con 0x7f41f0140b30 2024-04-15T14:59:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41e8001bf0 con 0x7f41f0140b30 2024-04-15T14:59:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f41e6ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:57.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f41ed59a640 4 set_mon_vals no callback set 2024-04-15T14:59:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.887+0000 7f8009704640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.887+0000 7f8009704640 10 monclient: monmap: 2024-04-15T14:59:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:57.894 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f8009704640 1 librados: starting msgr at 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f8009704640 1 librados: starting objecter 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f8009704640 1 Processor -- start 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f8009704640 1 -- start start 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f8009704640 1 librados: setting wanted keys 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f8009704640 1 librados: calling monclient init 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.888+0000 7f8009704640 10 monclient: init 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 10 monclient(hunting): picked mon.noname-a con 0x7f80040b57b0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 10 monclient(hunting): picked mon.noname-c con 0x7f80040b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 10 monclient(hunting): picked mon.noname-b con 0x7f8004146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8004144270 con 0x7f80040b57b0 2024-04-15T14:59:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8004144550 con 0x7f8004146d70 2024-04-15T14:59:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80041422d0 con 0x7f80040b5b90 2024-04-15T14:59:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.889+0000 7f8009704640 10 monclient(hunting): authenticate will time out at 1458.160296s 2024-04-15T14:59:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.890+0000 7f7ffbfff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f80040b5b90 0x7f80041dfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46042/0 (socket says 172.21.15.38:46042) 2024-04-15T14:59:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.890+0000 7f7ffbfff640 1 -- 172.21.15.38:0/1345843928 learned_addr learned my addr 172.21.15.38:0/1345843928 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.891+0000 7f7ffb7fe640 10 client.?.objecter ms_handle_connect 0x7f80040b5b90 2024-04-15T14:59:57.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.891+0000 7f7ffb7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.893+0000 7f7ffb7fe640 10 client.?.objecter ms_handle_connect 0x7f80040b57b0 2024-04-15T14:59:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.893+0000 7f7ffb7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.894+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449551819 0 0) 0x7f80041422d0 con 0x7f80040b5b90 2024-04-15T14:59:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.894+0000 7f7ffb7fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.894+0000 7f7ffb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.894+0000 7f7ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.894+0000 7f7ffb7fe640 10 monclient(hunting): my global_id is 54311 2024-04-15T14:59:57.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.894+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe8004eb0 con 0x7f80040b5b90 2024-04-15T14:59:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.898+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829351479 0 0) 0x7f8004144270 con 0x7f80040b57b0 2024-04-15T14:59:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.898+0000 7f7ffb7fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.898+0000 7f7ffb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.898+0000 7f7ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.898+0000 7f7ffb7fe640 10 monclient(hunting): my global_id is 4416 2024-04-15T14:59:57.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.898+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80041422d0 con 0x7f80040b57b0 2024-04-15T14:59:57.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.899+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 456800367 0 0) 0x7f7fe8004eb0 con 0x7f80040b5b90 2024-04-15T14:59:57.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.899+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8004144270 con 0x7f80040b5b90 2024-04-15T14:59:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.902+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f41e8003dc0 con 0x7f41f0140b30 2024-04-15T14:59:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.902+0000 7f41e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.902+0000 7f41e6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.902+0000 7f41e6ffd640 10 monclient: dump: 2024-04-15T14:59:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.903 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.904 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.903+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f41e8003f60 con 0x7f41f0140b30 2024-04-15T14:59:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7ff4001710 con 0x7f80040b5b90 2024-04-15T14:59:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 10 monclient(hunting): dump: 2024-04-15T14:59:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.906 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1696306308 0 0) 0x7f8004144270 con 0x7f80040b5b90 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 >> v1:172.21.15.164:6789/0 conn(0x7f8004146d70 legacy=0x7f80041e0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 >> v1:172.21.15.38:6789/0 conn(0x7f80040b57b0 legacy=0x7f8004139900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 1 monclient: found mon.c 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:57.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8004143360 con 0x7f80040b5b90 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f7ffb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f8009704640 5 monclient: authenticate success, global_id 54311 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f8009704640 10 monclient: _renew_subs 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f8009704640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8004141ef0 con 0x7f80040b5b90 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f8009704640 10 client.54311.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f8009704640 10 monclient: _renew_subs 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f8009704640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f800413a1f0 con 0x7f80040b5b90 2024-04-15T14:59:57.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f8009704640 1 librados: init done 2024-04-15T14:59:57.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.905+0000 7f41ee59c640 10 monclient: get_auth_request con 0x7f41d006ee50 auth_method 0 2024-04-15T14:59:57.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f41e6ffd640 10 client.4390.objecter ms_handle_connect 0x7f41d006ee50 2024-04-15T14:59:57.909 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f41e8053670 con 0x7f41f0140b30 2024-04-15T14:59:57.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f41e6ffd640 10 client.4390.objecter ms_dispatch 0x7f41f0000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:57.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f41e6ffd640 3 client.4390.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:57.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f41e6ffd640 3 client.4390.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:57.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f41e6ffd640 20 client.4390.objecter dump_active .. 0 homeless 2024-04-15T14:59:57.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f8009704640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:57.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f8009704640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:57.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f8009704640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:57.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.906+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8004077050 con 0x7f80040b5b90 2024-04-15T14:59:57.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.918+0000 7f6bd12ba640 10 monclient: get_monmap_and_config 2024-04-15T14:59:57.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.918+0000 7f6bd12ba640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.918+0000 7f6bd12ba640 10 monclient: monmap: 2024-04-15T14:59:57.919 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.919 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.919 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:57.919365+0000 2024-04-15T14:59:57.919 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:57.919365+0000 2024-04-15T14:59:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:57.920 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.919+0000 7f6bd12ba640 1 Processor -- start 2024-04-15T14:59:57.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.919+0000 7f6bd12ba640 1 -- start start 2024-04-15T14:59:57.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.919+0000 7f6bd12ba640 10 monclient: init 2024-04-15T14:59:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.920+0000 7f6bd12ba640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.920+0000 7f6bd12ba640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.920+0000 7f6bd12ba640 10 monclient(hunting): picked mon.noname-a con 0x7f6bcc1406c0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.920+0000 7f6bd12ba640 10 monclient(hunting): picked mon.noname-b con 0x7f6bcc0b0d50 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.920+0000 7f6bd12ba640 10 monclient(hunting): picked mon.noname-c con 0x7f6bcc0b02b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.920+0000 7f6bd12ba640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bcc140aa0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.920+0000 7f6bd12ba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bcc073380 con 0x7f6bcc0b02b0 2024-04-15T14:59:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.921+0000 7f6bd12ba640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bcc073550 con 0x7f6bcc0b0d50 2024-04-15T14:59:57.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.921+0000 7f6bd12ba640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.921+0000 7f6bd12ba640 10 monclient(hunting): authenticate will time out at 1458.191524s 2024-04-15T14:59:57.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.921+0000 7f6bcaffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6bcc1406c0 0x7f6bcc067790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55912/0 (socket says 172.21.15.38:55912) 2024-04-15T14:59:57.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.921+0000 7f6bcaffd640 1 -- 172.21.15.38:0/2320221181 learned_addr learned my addr 172.21.15.38:0/2320221181 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f6bca7fc640 1 -- 172.21.15.38:0/2320221181 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099456521 0 0) 0x7f6bcc140aa0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f6bca7fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f6bca7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f6bca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f6bca7fc640 10 monclient(hunting): my global_id is 4419 2024-04-15T14:59:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f6bca7fc640 1 -- 172.21.15.38:0/2320221181 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bb8003520 con 0x7f6bcc1406c0 2024-04-15T14:59:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ff40018c0 con 0x7f80040b5b90 2024-04-15T14:59:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f7ffb7fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7ff4003b80 con 0x7f80040b5b90 2024-04-15T14:59:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f7ffb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f7ffb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:57.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f7ffb7fe640 10 monclient: dump: 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.925+0000 7f8001ffb640 4 set_mon_vals no callback set 2024-04-15T14:59:57.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.926+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f7ff4003d60 con 0x7f80040b5b90 2024-04-15T14:59:57.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.928+0000 7f8002ffd640 10 monclient: get_auth_request con 0x7f7fe806ee90 auth_method 0 2024-04-15T14:59:57.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.928+0000 7f7ffb7fe640 10 client.54311.objecter ms_handle_connect 0x7f7fe806ee90 2024-04-15T14:59:57.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.928+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f7ff40534b0 con 0x7f80040b5b90 2024-04-15T14:59:57.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.928+0000 7f7ffb7fe640 10 client.54311.objecter ms_dispatch 0x7f8004000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:57.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 1 -- 172.21.15.38:0/2320221181 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2715280704 0 0) 0x7f6bb8003520 con 0x7f6bcc1406c0 2024-04-15T14:59:57.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 1 -- 172.21.15.38:0/2320221181 >> v1:172.21.15.38:6790/0 conn(0x7f6bcc0b0d50 legacy=0x7f6bcc143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:57.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 1 -- 172.21.15.38:0/2320221181 >> v1:172.21.15.164:6789/0 conn(0x7f6bcc0b02b0 legacy=0x7f6bcc14e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 1 monclient: found mon.noname-a 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 1 -- 172.21.15.38:0/2320221181 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc073720 con 0x7f6bcc1406c0 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 1 -- 172.21.15.38:0/2320221181 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6bbc001610 con 0x7f6bcc1406c0 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bca7fc640 10 monclient: dump: 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.931 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.932 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.932 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.932 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.932 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.932 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.932 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.932 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.932 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.928+0000 7f7ffb7fe640 3 client.54311.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:57.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.928+0000 7f7ffb7fe640 3 client.54311.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:57.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bd12ba640 5 monclient: authenticate success, global_id 4419 2024-04-15T14:59:57.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f6bd12ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:57.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.929+0000 7f7ffb7fe640 20 client.54311.objecter dump_active .. 0 homeless 2024-04-15T14:59:57.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.932+0000 7f6bca7fc640 1 -- 172.21.15.38:0/2320221181 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bbc001870 con 0x7f6bcc1406c0 2024-04-15T14:59:57.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.932+0000 7f6bca7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:57.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.932+0000 7f6bca7fc640 1 -- 172.21.15.38:0/2320221181 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6bbc001c40 con 0x7f6bcc1406c0 2024-04-15T14:59:57.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.932+0000 7f6bca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:57.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.932+0000 7f6bca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.932+0000 7f6bca7fc640 10 monclient: dump: 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.932+0000 7f6bd12ba640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.932+0000 7f6bd12ba640 4 set_mon_vals no callback set 2024-04-15T14:59:57.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.933+0000 7f6bd12ba640 10 monclient: shutdown 2024-04-15T14:59:57.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.933+0000 7f6bd12ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:57.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.933+0000 7f6bd12ba640 1 -- 172.21.15.38:0/2320221181 >> v1:172.21.15.38:6789/0 conn(0x7f6bcc1406c0 legacy=0x7f6bcc067790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.933+0000 7f6bd12ba640 1 -- 172.21.15.38:0/2320221181 shutdown_connections 2024-04-15T14:59:57.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.933+0000 7f6bd12ba640 1 -- 172.21.15.38:0/2320221181 >> 172.21.15.38:0/2320221181 conn(0x7f6bcc0b6360 msgr2=0x7f6bcc06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.933+0000 7f6bd12ba640 1 -- 172.21.15.38:0/2320221181 shutdown_connections 2024-04-15T14:59:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.933+0000 7f6bd12ba640 1 -- 172.21.15.38:0/2320221181 wait complete. 2024-04-15T14:59:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.934+0000 7f6bd12ba640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.934+0000 7f6bd12ba640 10 monclient: monmap: 2024-04-15T14:59:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:57.937 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.935+0000 7f6bd12ba640 1 librados: starting msgr at 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.935+0000 7f6bd12ba640 1 librados: starting objecter 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.935+0000 7f6bd12ba640 1 Processor -- start 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.935+0000 7f6bd12ba640 1 -- start start 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.936+0000 7f6bd12ba640 1 librados: setting wanted keys 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.936+0000 7f6bd12ba640 1 librados: calling monclient init 2024-04-15T14:59:57.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.936+0000 7f6bd12ba640 10 monclient: init 2024-04-15T14:59:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.937+0000 7f6bd12ba640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.937+0000 7f6bd12ba640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:59:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.937+0000 7f6bd12ba640 10 monclient(hunting): picked mon.noname-b con 0x7f6bcc0b02b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.937+0000 7f6bd12ba640 10 monclient(hunting): picked mon.noname-c con 0x7f6bcc0b0d50 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.937+0000 7f6bd12ba640 10 monclient(hunting): picked mon.noname-a con 0x7f6bcc1406c0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.937+0000 7f6bd12ba640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bcc0b42e0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.938+0000 7f6bd12ba640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bcc0b3490 con 0x7f6bcc0b02b0 2024-04-15T14:59:57.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.938+0000 7f6bd12ba640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bcc13b6d0 con 0x7f6bcc0b0d50 2024-04-15T14:59:57.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.938+0000 7f6bd12ba640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.938+0000 7f6bd12ba640 10 monclient(hunting): authenticate will time out at 1458.208714s 2024-04-15T14:59:57.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.938+0000 7f6bcb7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6bcc1406c0 0x7f6bcc1d8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55914/0 (socket says 172.21.15.38:55914) 2024-04-15T14:59:57.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.938+0000 7f6bcb7fe640 1 -- 172.21.15.38:0/1597745567 learned_addr learned my addr 172.21.15.38:0/1597745567 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.939+0000 7f6bc37fe640 10 client.?.objecter ms_handle_connect 0x7f6bcc1406c0 2024-04-15T14:59:57.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.939+0000 7f6bc37fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:57.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.941+0000 7fb8ef318640 10 monclient: get_monmap_and_config 2024-04-15T14:59:57.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.941+0000 7fb8ef318640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.941+0000 7fb8ef318640 10 monclient: monmap: 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:57.942618+0000 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:57.942618+0000 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:57.943 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.942+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945588031 0 0) 0x7f6bcc0b42e0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.942+0000 7f6bc37fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.942+0000 7f6bc37fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.942+0000 7f6bc37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.942+0000 7f6bc37fe640 10 monclient(hunting): my global_id is 4422 2024-04-15T14:59:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.942+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bac004eb0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.942+0000 7fb8ef318640 1 Processor -- start 2024-04-15T14:59:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.942+0000 7fb8ef318640 1 -- start start 2024-04-15T14:59:57.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.942+0000 7fb8ef318640 10 monclient: init 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 10 monclient(hunting): picked mon.noname-c con 0x7fb8e80b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 10 monclient(hunting): picked mon.noname-b con 0x7fb8e80b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 10 monclient(hunting): picked mon.noname-a con 0x7fb8e8146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e8140ca0 con 0x7fb8e8146d70 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e80ab0e0 con 0x7fb8e80b57b0 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e80b3310 con 0x7fb8e80b5b90 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.943+0000 7fb8ef318640 10 monclient(hunting): authenticate will time out at 1458.213979s 2024-04-15T14:59:57.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.944+0000 7f96e92ce640 10 monclient: get_monmap_and_config 2024-04-15T14:59:57.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.944+0000 7f96e92ce640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.944+0000 7f96e92ce640 10 monclient: monmap: 2024-04-15T14:59:57.947 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.947 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:57.945346+0000 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:57.945346+0000 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.945+0000 7f96e92ce640 1 Processor -- start 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.945+0000 7f96e92ce640 1 -- start start 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.945+0000 7f96e92ce640 10 monclient: init 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 10 monclient(hunting): picked mon.noname-b con 0x7f96e40b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:57.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 10 monclient(hunting): picked mon.noname-a con 0x7f96e40b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 10 monclient(hunting): picked mon.noname-c con 0x7f96e4146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e4140ca0 con 0x7f96e40b5b90 2024-04-15T14:59:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e40ab0e0 con 0x7f96e4146d70 2024-04-15T14:59:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e40b3310 con 0x7f96e40b57b0 2024-04-15T14:59:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:57.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.946+0000 7f96e92ce640 10 monclient(hunting): authenticate will time out at 1458.216565s 2024-04-15T14:59:57.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.950+0000 7f96dbfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f96e40b5b90 0x7f96e4146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55928/0 (socket says 172.21.15.38:55928) 2024-04-15T14:59:57.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.950+0000 7f96dbfff640 1 -- 172.21.15.38:0/3664864159 learned_addr learned my addr 172.21.15.38:0/3664864159 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.951+0000 7fb8ed8b5640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb8e8146d70 0x7fb8e814ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:55926/0 (socket says 172.21.15.38:55926) 2024-04-15T14:59:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.951+0000 7fb8ed8b5640 1 -- 172.21.15.38:0/1883858475 learned_addr learned my addr 172.21.15.38:0/1883858475 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.951+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3478476743 0 0) 0x7f6bac004eb0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.951+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bcc0b42e0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.951+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6bc4001a50 con 0x7f6bcc1406c0 2024-04-15T14:59:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.951+0000 7f6bc37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.951+0000 7f6bc37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.951+0000 7f6bc37fe640 10 monclient(hunting): dump: 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.951+0000 7f6bc37fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:57.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1474918176 0 0) 0x7f6bcc0b42e0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 >> v1:172.21.15.38:6790/0 conn(0x7f6bcc0b0d50 legacy=0x7f6bcc1d8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924397352 0 0) 0x7fb8e8140ca0 con 0x7fb8e8146d70 2024-04-15T14:59:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7fb8dffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7fb8dffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7fb8dffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7fb8dffff640 10 monclient(hunting): my global_id is 4425 2024-04-15T14:59:57.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8d4003520 con 0x7fb8e8146d70 2024-04-15T14:59:57.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 >> v1:172.21.15.164:6789/0 conn(0x7f6bcc0b02b0 legacy=0x7f6bcc133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 1 monclient: found mon.a 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc13b8a0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bc37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bd12ba640 5 monclient: authenticate success, global_id 4422 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bd12ba640 10 monclient: _renew_subs 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bd12ba640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6bcc0b3d10 con 0x7f6bcc1406c0 2024-04-15T14:59:57.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bd12ba640 10 client.4422.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bd12ba640 10 monclient: _renew_subs 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bd12ba640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6bcc135770 con 0x7f6bcc1406c0 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.958+0000 7f6bd12ba640 1 librados: init done 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.959+0000 7f6bd12ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.959+0000 7f6bd12ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.959+0000 7f6bd12ba640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.959+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bcc0505a0 con 0x7f6bcc1406c0 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.963+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683602063 0 0) 0x7f96e4140ca0 con 0x7f96e40b5b90 2024-04-15T14:59:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.963+0000 7f96e27fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.963+0000 7f96e27fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.963+0000 7f96e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.963+0000 7f96e27fc640 10 monclient(hunting): my global_id is 4428 2024-04-15T14:59:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.963+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96d0003520 con 0x7f96e40b5b90 2024-04-15T14:59:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.998+0000 7f8d5f972640 10 monclient: get_monmap_and_config 2024-04-15T14:59:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.998+0000 7f8d5f972640 10 monclient: build_initial_monmap 2024-04-15T14:59:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.998+0000 7f8d5f972640 10 monclient: monmap: 2024-04-15T14:59:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:57.999 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:57.999250+0000 2024-04-15T14:59:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:57.999250+0000 2024-04-15T14:59:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:58.000 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:58.000 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.999+0000 7f8d5f972640 1 Processor -- start 2024-04-15T14:59:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.999+0000 7f8d5f972640 1 -- start start 2024-04-15T14:59:58.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.999+0000 7f8d5f972640 10 monclient: init 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.999+0000 7f8d5f972640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.999+0000 7f8d5f972640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.999+0000 7f8d5f972640 10 monclient(hunting): picked mon.noname-b con 0x7f8d580b57d0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:57.999+0000 7f8d5f972640 10 monclient(hunting): picked mon.noname-c con 0x7f8d580b5bb0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.000+0000 7f8d5f972640 10 monclient(hunting): picked mon.noname-a con 0x7f8d58140b30 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.000+0000 7f8d5f972640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d58146e10 con 0x7f8d58140b30 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.000+0000 7f8d5f972640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d580aa840 con 0x7f8d580b5bb0 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.000+0000 7f8d5f972640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d580aa460 con 0x7f8d580b57d0 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.000+0000 7f8d5f972640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:58.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.000+0000 7f8d5f972640 10 monclient(hunting): authenticate will time out at 1458.270548s 2024-04-15T14:59:58.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.142+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f41e8055a70 con 0x7f41f0140b30 2024-04-15T14:59:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.142+0000 7f41e6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.142+0000 7f41e6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:58.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.148+0000 7f8d5cf0d640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f8d580b5bb0 0x7f8d58140420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:37130/0 (socket says 172.21.15.38:37130) 2024-04-15T14:59:58.149 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.148+0000 7f8d5cf0d640 1 -- 172.21.15.38:0/1589976921 learned_addr learned my addr 172.21.15.38:0/1589976921 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.149+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441156173 0 0) 0x7fb8e80ab0e0 con 0x7fb8e80b57b0 2024-04-15T14:59:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.149+0000 7fb8dffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.149+0000 7fb8dffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.149+0000 7fb8dffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:58.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.149+0000 7fb8dffff640 10 monclient(hunting): my global_id is 4396 2024-04-15T14:59:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.149+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e8140ca0 con 0x7fb8e80b57b0 2024-04-15T14:59:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.150+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1125983253 0 0) 0x7f96e40ab0e0 con 0x7f96e4146d70 2024-04-15T14:59:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.150+0000 7f96e27fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.150+0000 7f96e27fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.150+0000 7f96e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.150+0000 7f96e27fc640 10 monclient(hunting): my global_id is 4399 2024-04-15T14:59:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.150+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96e4140ca0 con 0x7f96e4146d70 2024-04-15T14:59:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1973983325 0 0) 0x7fb8e8140ca0 con 0x7fb8e80b57b0 2024-04-15T14:59:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 >> v1:172.21.15.38:6790/0 conn(0x7fb8e80b5b90 legacy=0x7fb8e8146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 >> v1:172.21.15.38:6789/0 conn(0x7fb8e8146d70 legacy=0x7fb8e814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 1 monclient: found mon.noname-c 2024-04-15T14:59:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e80aa460 con 0x7fb8e80b57b0 2024-04-15T14:59:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 10 monclient: _finish_auth 0 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb8e4001610 con 0x7fb8e80b57b0 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8ef318640 5 monclient: authenticate success, global_id 4396 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8ef318640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8dffff640 10 monclient: dump: 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.160 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7fb8ef318640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7f8d4ffff640 1 -- 172.21.15.38:0/1589976921 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052758200 0 0) 0x7f8d580aa840 con 0x7f8d580b5bb0 2024-04-15T14:59:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7f8d4ffff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7f8d4ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7f8d4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7f8d4ffff640 10 monclient(hunting): my global_id is 4402 2024-04-15T14:59:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.155+0000 7f8d4ffff640 1 -- 172.21.15.38:0/1589976921 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d44003520 con 0x7f8d580b5bb0 2024-04-15T14:59:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2283602652 0 0) 0x7f96e4140ca0 con 0x7f96e4146d70 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 >> v1:172.21.15.38:6790/0 conn(0x7f96e40b57b0 legacy=0x7f96e4140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 >> v1:172.21.15.38:6789/0 conn(0x7f96e40b5b90 legacy=0x7f96e4146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 1 monclient: found mon.noname-c 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e40aa460 con 0x7f96e4146d70 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f96dc001990 con 0x7f96e4146d70 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e27fc640 10 monclient: dump: 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e92ce640 5 monclient: authenticate success, global_id 4399 2024-04-15T14:59:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.158+0000 7f96e92ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8e4001870 con 0x7fb8e80b57b0 2024-04-15T14:59:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8dffff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8dffff640 1 -- 172.21.15.38:0/1883858475 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb8e4001c80 con 0x7fb8e80b57b0 2024-04-15T14:59:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8dffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8dffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8dffff640 10 monclient: dump: 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8ef318640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:58.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8ef318640 4 set_mon_vals no callback set 2024-04-15T14:59:58.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 1 -- 172.21.15.38:0/1589976921 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3319747255 0 0) 0x7f8d44003520 con 0x7f8d580b5bb0 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 1 -- 172.21.15.38:0/1589976921 >> v1:172.21.15.38:6790/0 conn(0x7f8d580b57d0 legacy=0x7f8d58146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 1 -- 172.21.15.38:0/1589976921 >> v1:172.21.15.38:6789/0 conn(0x7f8d58140b30 legacy=0x7f8d5814ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 1 monclient: found mon.noname-c 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 1 -- 172.21.15.38:0/1589976921 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d580b2970 con 0x7f8d580b5bb0 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 10 monclient: _finish_auth 0 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:58.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 1 -- 172.21.15.38:0/1589976921 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8d48001610 con 0x7f8d580b5bb0 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d5f972640 5 monclient: authenticate success, global_id 4402 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d5f972640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d4ffff640 10 monclient: dump: 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.168 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.169 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.169 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.169 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7f8d5f972640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:58.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8ef318640 10 monclient: shutdown 2024-04-15T14:59:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8ef318640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.163+0000 7fb8ef318640 1 -- 172.21.15.38:0/1883858475 >> v1:172.21.15.164:6789/0 conn(0x7fb8e80b57b0 legacy=0x7fb8e8140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.164+0000 7fb8ef318640 1 -- 172.21.15.38:0/1883858475 shutdown_connections 2024-04-15T14:59:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.164+0000 7fb8ef318640 1 -- 172.21.15.38:0/1883858475 >> 172.21.15.38:0/1883858475 conn(0x7fb8e8067790 msgr2=0x7fb8e8067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.164+0000 7fb8ef318640 1 -- 172.21.15.38:0/1883858475 shutdown_connections 2024-04-15T14:59:58.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.164+0000 7fb8ef318640 1 -- 172.21.15.38:0/1883858475 wait complete. 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96dc001bf0 con 0x7f96e4146d70 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e27fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e27fc640 1 -- 172.21.15.38:0/3664864159 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f96dc002000 con 0x7f96e4146d70 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e27fc640 10 monclient: dump: 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.171 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.172 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.172 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.172 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.172 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.172 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.172 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e92ce640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:58.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e92ce640 4 set_mon_vals no callback set 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7fb8ef318640 10 monclient: build_initial_monmap 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7fb8ef318640 10 monclient: monmap: 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7fb8ef318640 1 librados: starting msgr at 2024-04-15T14:59:58.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7fb8ef318640 1 librados: starting objecter 2024-04-15T14:59:58.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7fb8ef318640 1 Processor -- start 2024-04-15T14:59:58.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e92ce640 10 monclient: shutdown 2024-04-15T14:59:58.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e92ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:58.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e92ce640 1 -- 172.21.15.38:0/3664864159 >> v1:172.21.15.164:6789/0 conn(0x7f96e4146d70 legacy=0x7f96e414ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e92ce640 1 -- 172.21.15.38:0/3664864159 shutdown_connections 2024-04-15T14:59:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7fb8ef318640 1 -- start start 2024-04-15T14:59:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7fb8ef318640 1 librados: setting wanted keys 2024-04-15T14:59:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7fb8ef318640 1 librados: calling monclient init 2024-04-15T14:59:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7fb8ef318640 10 monclient: init 2024-04-15T14:59:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e92ce640 1 -- 172.21.15.38:0/3664864159 >> 172.21.15.38:0/3664864159 conn(0x7f96e4067790 msgr2=0x7f96e4067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e92ce640 1 -- 172.21.15.38:0/3664864159 shutdown_connections 2024-04-15T14:59:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.165+0000 7f96e92ce640 1 -- 172.21.15.38:0/3664864159 wait complete. 2024-04-15T14:59:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 10 monclient(hunting): picked mon.noname-c con 0x7fb8e80b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 10 monclient(hunting): picked mon.noname-b con 0x7fb8e80b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 10 monclient(hunting): picked mon.noname-a con 0x7fb8e8146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e80ade00 con 0x7fb8e8146d70 2024-04-15T14:59:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e80ae0e0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e80ad040 con 0x7fb8e80b57b0 2024-04-15T14:59:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7fb8ef318640 10 monclient(hunting): authenticate will time out at 1458.436988s 2024-04-15T14:59:58.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7f96e92ce640 10 monclient: build_initial_monmap 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7f96e92ce640 10 monclient: monmap: 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7f96e92ce640 1 librados: starting msgr at 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.166+0000 7f96e92ce640 1 librados: starting objecter 2024-04-15T14:59:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 1 Processor -- start 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 1 -- start start 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 1 librados: setting wanted keys 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 1 librados: calling monclient init 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 10 monclient: init 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 10 monclient(hunting): picked mon.noname-b con 0x7f96e40b57b0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 10 monclient(hunting): picked mon.noname-a con 0x7f96e40b5b90 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 10 monclient(hunting): picked mon.noname-c con 0x7f96e4146d70 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e413bd20 con 0x7f96e40b5b90 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e413c040 con 0x7f96e40b57b0 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e413aba0 con 0x7f96e4146d70 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.167+0000 7f96e92ce640 10 monclient(hunting): authenticate will time out at 1458.438136s 2024-04-15T14:59:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d4ffff640 1 -- 172.21.15.38:0/1589976921 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d48001870 con 0x7f8d580b5bb0 2024-04-15T14:59:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d4ffff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d4ffff640 1 -- 172.21.15.38:0/1589976921 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8d48001cc0 con 0x7f8d580b5bb0 2024-04-15T14:59:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d5f972640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d5f972640 4 set_mon_vals no callback set 2024-04-15T14:59:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d4ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d4ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d4ffff640 10 monclient: dump: 2024-04-15T14:59:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f96e2ffd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f96e40b57b0 0x7f96e41db9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:37142/0 (socket says 172.21.15.38:37142) 2024-04-15T14:59:58.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f96e2ffd640 1 -- 172.21.15.38:0/2735561449 learned_addr learned my addr 172.21.15.38:0/2735561449 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7fb8ec8b3640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fb8e80b5b90 0x7fb8e81371e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:37136/0 (socket says 172.21.15.38:37136) 2024-04-15T14:59:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7fb8ec8b3640 1 -- 172.21.15.38:0/990007799 learned_addr learned my addr 172.21.15.38:0/990007799 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d5f972640 10 monclient: shutdown 2024-04-15T14:59:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d5f972640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d5f972640 1 -- 172.21.15.38:0/1589976921 >> v1:172.21.15.164:6789/0 conn(0x7f8d580b5bb0 legacy=0x7f8d58140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d5f972640 1 -- 172.21.15.38:0/1589976921 shutdown_connections 2024-04-15T14:59:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d5f972640 1 -- 172.21.15.38:0/1589976921 >> 172.21.15.38:0/1589976921 conn(0x7f8d58067790 msgr2=0x7f8d58067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7fb8ddffb640 10 client.?.objecter ms_handle_connect 0x7fb8e80b5b90 2024-04-15T14:59:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7fb8ddffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f8d5f972640 1 -- 172.21.15.38:0/1589976921 shutdown_connections 2024-04-15T14:59:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f96db7fe640 10 client.?.objecter ms_handle_connect 0x7f96e40b57b0 2024-04-15T14:59:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.169+0000 7f96db7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.170+0000 7f8d5f972640 1 -- 172.21.15.38:0/1589976921 wait complete. 2024-04-15T14:59:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.170+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bc4004be0 con 0x7f6bcc1406c0 2024-04-15T14:59:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.170+0000 7f6bc37fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.170+0000 7f6bc9ffb640 4 set_mon_vals no callback set 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.170+0000 7f8d5f972640 10 monclient: build_initial_monmap 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.170+0000 7f8d5f972640 10 monclient: monmap: 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.170+0000 7f8d5f972640 1 librados: starting msgr at 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.170+0000 7f8d5f972640 1 librados: starting objecter 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.170+0000 7f8d5f972640 1 Processor -- start 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 1 -- start start 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 1 librados: setting wanted keys 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 1 librados: calling monclient init 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 10 monclient: init 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 10 monclient(hunting): picked mon.noname-a con 0x7f8d580b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 10 monclient(hunting): picked mon.noname-c con 0x7f8d580b5bb0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 10 monclient(hunting): picked mon.noname-b con 0x7f8d58140b30 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d580b0150 con 0x7f8d580b57d0 2024-04-15T14:59:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d581dc1f0 con 0x7f8d58140b30 2024-04-15T14:59:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d58145310 con 0x7f8d580b5bb0 2024-04-15T14:59:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.171+0000 7f8d5f972640 10 monclient(hunting): authenticate will time out at 1458.442199s 2024-04-15T14:59:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626233168 0 0) 0x7f96e413c040 con 0x7f96e40b57b0 2024-04-15T14:59:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7f96db7fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7f96db7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7f96db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7f96db7fe640 10 monclient(hunting): my global_id is 4408 2024-04-15T14:59:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96c4004eb0 con 0x7f96e40b57b0 2024-04-15T14:59:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326397276 0 0) 0x7fb8e80ae0e0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7fb8ddffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7fb8ddffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7fb8ddffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7fb8ddffb640 10 monclient(hunting): my global_id is 4405 2024-04-15T14:59:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.174+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8cc004eb0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.175+0000 7f8d5df0f640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f8d58140b30 0x7f8d581d8060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:37150/0 (socket says 172.21.15.38:37150) 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.175+0000 7f8d5df0f640 1 -- 172.21.15.38:0/2450794155 learned_addr learned my addr 172.21.15.38:0/2450794155 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.180+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1336427973 0 0) 0x7f96c4004eb0 con 0x7f96e40b57b0 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.180+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96e413c040 con 0x7f96e40b57b0 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.180+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f96d40018e0 con 0x7f96e40b57b0 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.180+0000 7f96db7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.180+0000 7f96db7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.180+0000 7f96db7fe640 10 monclient(hunting): dump: 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.191 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.180+0000 7f96db7fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.180+0000 7f8d4dffb640 10 client.?.objecter ms_handle_connect 0x7f8d58140b30 2024-04-15T14:59:58.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.180+0000 7f8d4dffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.185+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2520983840 0 0) 0x7fb8cc004eb0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.185+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8e80ae0e0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.185+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb8d80018e0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.185+0000 7fb8ddffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.185+0000 7fb8ddffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.185+0000 7fb8ddffb640 10 monclient(hunting): dump: 2024-04-15T14:59:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.193 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.185+0000 7fb8ddffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.189+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220602825 0 0) 0x7f8d581dc1f0 con 0x7f8d58140b30 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.189+0000 7f8d4dffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:58.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.189+0000 7f8d4dffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.189+0000 7f8d4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.189+0000 7f8d4dffb640 10 monclient(hunting): my global_id is 4411 2024-04-15T14:59:58.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d3c004eb0 con 0x7f8d58140b30 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2653815067 0 0) 0x7f96e413c040 con 0x7f96e40b57b0 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 >> v1:172.21.15.38:6790/0 conn(0x7f96e4146d70 legacy=0x7f96e41e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 >> v1:172.21.15.38:6789/0 conn(0x7f96e40b5b90 legacy=0x7f96e41dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 1 monclient: found mon.b 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e413ad70 con 0x7f96e40b57b0 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:58.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96e92ce640 5 monclient: authenticate success, global_id 4408 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96e92ce640 10 monclient: _renew_subs 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96e92ce640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f96e413af80 con 0x7f96e40b57b0 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96e92ce640 10 client.4408.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96e92ce640 10 monclient: _renew_subs 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96e92ce640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f96e413b820 con 0x7f96e40b57b0 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.190+0000 7f96e92ce640 1 librados: init done 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.191+0000 7f96e92ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.191+0000 7f96e92ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.191+0000 7f96e92ce640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.191+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e413b1b0 con 0x7f96e40b57b0 2024-04-15T14:59:58.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.193+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f7ff40558b0 con 0x7f80040b5b90 2024-04-15T14:59:58.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.193+0000 7f7ffb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.193+0000 7f7ffb7fe640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:58.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.200+0000 7fb8ddffb640 10 client.?.objecter ms_handle_connect 0x7fb8e80b57b0 2024-04-15T14:59:58.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.200+0000 7fb8ddffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.202+0000 7f8d4dffb640 10 client.?.objecter ms_handle_connect 0x7f8d580b5bb0 2024-04-15T14:59:58.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.202+0000 7f8d4dffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.202+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2443319559 0 0) 0x7fb8e80ae0e0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.202+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 >> v1:172.21.15.38:6790/0 conn(0x7fb8e80b57b0 legacy=0x7fb8e8143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.202+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 >> v1:172.21.15.38:6789/0 conn(0x7fb8e8146d70 legacy=0x7fb8e8141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ddffb640 10 monclient: _finish_hunting 0 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ddffb640 1 monclient: found mon.b 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ddffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ddffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e80acb10 con 0x7fb8e80b5b90 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ddffb640 10 monclient: _finish_auth 0 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ddffb640 10 monclient: _check_auth_tickets 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ef318640 5 monclient: authenticate success, global_id 4405 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ef318640 10 monclient: _renew_subs 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ef318640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e81378f0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ef318640 10 client.4405.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ef318640 10 monclient: _renew_subs 2024-04-15T14:59:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ef318640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8e8141950 con 0x7fb8e80b5b90 2024-04-15T14:59:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.203+0000 7fb8ef318640 1 librados: init done 2024-04-15T14:59:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.204+0000 7fb8ef318640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.204+0000 7fb8ef318640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.204+0000 7fb8ef318640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.204+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e8077050 con 0x7fb8e80b5b90 2024-04-15T14:59:58.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.206+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3487400427 0 0) 0x7f8d3c004eb0 con 0x7f8d58140b30 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.206+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d581dc1f0 con 0x7f8d58140b30 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.206+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8d50001a50 con 0x7f8d58140b30 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.206+0000 7f8d4dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.206+0000 7f8d4dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.206+0000 7f8d4dffb640 10 monclient(hunting): dump: 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.208 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.209 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.206+0000 7f8d4dffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.207+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501789931 0 0) 0x7f8d58145310 con 0x7f8d580b5bb0 2024-04-15T14:59:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.207+0000 7f8d4dffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.207+0000 7f8d4dffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.207+0000 7f8d4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.207+0000 7f8d4dffb640 10 monclient(hunting): my global_id is 54317 2024-04-15T14:59:58.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.207+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d3c004eb0 con 0x7f8d580b5bb0 2024-04-15T14:59:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.212+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2217350513 0 0) 0x7f8d3c004eb0 con 0x7f8d580b5bb0 2024-04-15T14:59:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.212+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d58145310 con 0x7f8d580b5bb0 2024-04-15T14:59:58.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.212+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8d48001bc0 con 0x7f8d580b5bb0 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.212+0000 7f8d4dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.212+0000 7f8d4dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.212+0000 7f8d4dffb640 10 monclient(hunting): dump: 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 797767946 0 0) 0x7f8d58145310 con 0x7f8d580b5bb0 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 >> v1:172.21.15.164:6789/0 conn(0x7f8d58140b30 legacy=0x7f8d581d8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 >> v1:172.21.15.38:6789/0 conn(0x7f8d580b57d0 legacy=0x7f8d580b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 10 monclient: _finish_hunting 0 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 1 monclient: found mon.c 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d581454e0 con 0x7f8d580b5bb0 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 10 monclient: _finish_auth 0 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 10 monclient: _check_auth_tickets 2024-04-15T14:59:58.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d4dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d5f972640 5 monclient: authenticate success, global_id 54317 2024-04-15T14:59:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d5f972640 10 monclient: _renew_subs 2024-04-15T14:59:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d5f972640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8d581dba80 con 0x7f8d580b5bb0 2024-04-15T14:59:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d5f972640 10 client.54317.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d5f972640 10 monclient: _renew_subs 2024-04-15T14:59:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d5f972640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.216+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8d581dbf50 con 0x7f8d580b5bb0 2024-04-15T14:59:58.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.217+0000 7f8d5f972640 1 librados: init done 2024-04-15T14:59:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.218+0000 7f8d5f972640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.218+0000 7f8d5f972640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.218+0000 7f8d5f972640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:58.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.218+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d58077050 con 0x7f8d580b5bb0 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.293+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6bc4004f30 con 0x7f6bcc1406c0 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.293+0000 7f6bc37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.293+0000 7f6bc37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.293+0000 7f6bc37fe640 10 monclient: dump: 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.294 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.295 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.295 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.294+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f6bc401b460 con 0x7f6bcc1406c0 2024-04-15T14:59:58.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.295+0000 7f6bcaffd640 10 monclient: get_auth_request con 0x7f6bac06edf0 auth_method 0 2024-04-15T14:59:58.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.295+0000 7f6bc37fe640 10 client.4422.objecter ms_handle_connect 0x7f6bac06edf0 2024-04-15T14:59:58.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.301+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f6bc40537a0 con 0x7f6bcc1406c0 2024-04-15T14:59:58.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.301+0000 7f6bc37fe640 10 client.4422.objecter ms_dispatch 0x7f6bcc000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:58.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.301+0000 7f6bc37fe640 3 client.4422.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:58.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.301+0000 7f6bc37fe640 3 client.4422.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:58.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.302+0000 7f6bc37fe640 20 client.4422.objecter dump_active .. 0 homeless 2024-04-15T14:59:58.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.302+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f6bc4055ba0 con 0x7f6bcc1406c0 2024-04-15T14:59:58.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.302+0000 7f6bc37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.302+0000 7f6bc37fe640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.389+0000 7f41f4ea6640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-15T14:59:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.390+0000 7f41f4ea6640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-15T14:59:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.390+0000 7f41f4ea6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.390+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f41f0077050 con 0x7f41f0140b30 2024-04-15T14:59:58.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.395+0000 7f8009704640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-15T14:59:58.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.395+0000 7f8009704640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-15T14:59:58.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.395+0000 7f8009704640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:58.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.395+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f80041420c0 con 0x7f80040b5b90 2024-04-15T14:59:58.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.414+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96d4001cc0 con 0x7f96e40b57b0 2024-04-15T14:59:58.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.414+0000 7f96db7fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:58.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.414+0000 7f96e1ffb640 4 set_mon_vals no callback set 2024-04-15T14:59:58.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.445+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f96d4003a40 con 0x7f96e40b57b0 2024-04-15T14:59:58.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.445+0000 7f96db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.445+0000 7f96db7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:58.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.445+0000 7f96db7fe640 10 monclient: dump: 2024-04-15T14:59:58.446 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.446 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.446 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.447 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.447 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.447 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.447 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.447 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.447 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.447 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.446+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f96d4003c60 con 0x7f96e40b57b0 2024-04-15T14:59:58.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.446+0000 7f96dbfff640 10 monclient: get_auth_request con 0x7f96c406ed60 auth_method 0 2024-04-15T14:59:58.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.447+0000 7f96db7fe640 10 client.4408.objecter ms_handle_connect 0x7f96c406ed60 2024-04-15T14:59:58.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.447+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f96d4053530 con 0x7f96e40b57b0 2024-04-15T14:59:58.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.448+0000 7f96db7fe640 10 client.4408.objecter ms_dispatch 0x7f96e4000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:58.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.448+0000 7f96db7fe640 3 client.4408.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:58.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.448+0000 7f96db7fe640 3 client.4408.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:58.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.448+0000 7f96db7fe640 20 client.4408.objecter dump_active .. 0 homeless 2024-04-15T14:59:58.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.450+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f96d4055930 con 0x7f96e40b57b0 2024-04-15T14:59:58.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.450+0000 7f96db7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.450+0000 7f96db7fe640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:58.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.490+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d48001870 con 0x7f8d580b5bb0 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.490+0000 7f8d4dffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.490+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8d48004dd0 con 0x7f8d580b5bb0 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.490+0000 7f8d4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.490+0000 7f8d4dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.490+0000 7f8d4dffb640 10 monclient: dump: 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.492 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.493 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.493 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.493 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.490+0000 7f8d4f7fe640 4 set_mon_vals no callback set 2024-04-15T14:59:58.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.492+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f8d4801b300 con 0x7f8d580b5bb0 2024-04-15T14:59:58.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.493+0000 7f8d5d70e640 10 monclient: get_auth_request con 0x7f8d3c06edd0 auth_method 0 2024-04-15T14:59:58.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.493+0000 7f8d4dffb640 10 client.54317.objecter ms_handle_connect 0x7f8d3c06edd0 2024-04-15T14:59:58.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.497+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f8d480533f0 con 0x7f8d580b5bb0 2024-04-15T14:59:58.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.497+0000 7f8d4dffb640 10 client.54317.objecter ms_dispatch 0x7f8d58000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:58.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.497+0000 7f8d4dffb640 3 client.54317.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:58.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.497+0000 7f8d4dffb640 3 client.54317.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:58.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.497+0000 7f8d4dffb640 20 client.54317.objecter dump_active .. 0 homeless 2024-04-15T14:59:58.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.497+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f8d48085e20 con 0x7f8d580b5bb0 2024-04-15T14:59:58.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.497+0000 7f8d4dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.497+0000 7f8d4dffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:58.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.504+0000 7f7ffb7fe640 1 -- 172.21.15.38:0/1345843928 <== mon.2 v1:172.21.15.38:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 4171326081) 0x7f7ff40551b0 con 0x7f80040b5b90 2024-04-15T14:59:58.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.504+0000 7f7ffb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-04-15T14:59:58.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.504+0000 7f7ffb7fe640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:58.505 INFO:teuthology.orchestra.run.smithi038.stdout:55834574856 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 10 librados: watch_flush enter 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 10 librados: watch_flush exit 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 20 client.54311.objecter shutdown clearing up homeless session... 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 10 client.54311.objecter successfully canceled tick 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 >> v1:172.21.15.38:6800/1608957829 conn(0x7f7fe806ee90 legacy=0x7f7fe8071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 10 monclient: shutdown 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 >> v1:172.21.15.38:6790/0 conn(0x7f80040b5b90 legacy=0x7f80041dfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 shutdown_connections 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.506+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 >> 172.21.15.38:0/1345843928 conn(0x7f8004067790 msgr2=0x7f80040b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.507+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 shutdown_connections 2024-04-15T14:59:58.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.507+0000 7f8009704640 1 -- 172.21.15.38:0/1345843928 wait complete. 2024-04-15T14:59:58.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.507+0000 7f8009704640 1 librados: shutdown 2024-04-15T14:59:58.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.508+0000 7f6bd12ba640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-15T14:59:58.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.508+0000 7f6bd12ba640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-15T14:59:58.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.508+0000 7f6bd12ba640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T14:59:58.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.508+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6bcc13b260 con 0x7f6bcc1406c0 2024-04-15T14:59:58.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-04-15T14:59:58.519 DEBUG:teuthology.parallel:result is None 2024-04-15T14:59:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.521+0000 7f6bc37fe640 1 -- 172.21.15.38:0/1597745567 <== mon.0 v1:172.21.15.38:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 2115387486) 0x7f6bc40554a0 con 0x7f6bcc1406c0 2024-04-15T14:59:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.521+0000 7f6bc37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-15T14:59:58.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.521+0000 7f6bc37fe640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:58.523 INFO:teuthology.orchestra.run.smithi038.stdout:90194313223 2024-04-15T14:59:58.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 10 librados: watch_flush enter 2024-04-15T14:59:58.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 10 librados: watch_flush exit 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 20 client.4422.objecter shutdown clearing up homeless session... 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 10 client.4422.objecter successfully canceled tick 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 >> v1:172.21.15.38:6800/1608957829 conn(0x7f6bac06edf0 legacy=0x7f6bac0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 10 monclient: shutdown 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 >> v1:172.21.15.38:6789/0 conn(0x7f6bcc1406c0 legacy=0x7f6bcc1d8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 shutdown_connections 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 >> 172.21.15.38:0/1597745567 conn(0x7f6bcc0b6360 msgr2=0x7f6bcc13a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 shutdown_connections 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 1 -- 172.21.15.38:0/1597745567 wait complete. 2024-04-15T14:59:58.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.524+0000 7f6bd12ba640 1 librados: shutdown 2024-04-15T14:59:58.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313223 got 90194313223 for osd.5 2024-04-15T14:59:58.536 DEBUG:teuthology.parallel:result is None 2024-04-15T14:59:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.684+0000 7f96e92ce640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-15T14:59:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.684+0000 7f96e92ce640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-15T14:59:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.684+0000 7f96e92ce640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.684+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f96e413bb10 con 0x7f96e40b57b0 2024-04-15T14:59:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.705+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8d8001cc0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.705+0000 7fb8ddffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.705+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb8d8003a40 con 0x7fb8e80b5b90 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.705+0000 7fb8ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.705+0000 7fb8ddffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.705+0000 7fb8ddffb640 10 monclient: dump: 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.705+0000 7fb8df7fe640 4 set_mon_vals no callback set 2024-04-15T14:59:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.706+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fb8d8003be0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.707+0000 7fb8ed0b4640 10 monclient: get_auth_request con 0x7fb8cc06edd0 auth_method 0 2024-04-15T14:59:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.707+0000 7fb8ddffb640 10 client.4405.objecter ms_handle_connect 0x7fb8cc06edd0 2024-04-15T14:59:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.708+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fb8d80534b0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.708+0000 7fb8ddffb640 10 client.4405.objecter ms_dispatch 0x7fb8e8000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:58.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.708+0000 7fb8ddffb640 3 client.4405.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:58.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.708+0000 7fb8ddffb640 3 client.4405.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:58.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.708+0000 7fb8ddffb640 20 client.4405.objecter dump_active .. 0 homeless 2024-04-15T14:59:58.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.710+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fb8d80558b0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.710+0000 7fb8ddffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:58.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.710+0000 7fb8ddffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.713+0000 7f41e6ffd640 1 -- 172.21.15.38:0/3809779732 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 3181228111) 0x7f41e8055370 con 0x7f41f0140b30 2024-04-15T14:59:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.713+0000 7f41e6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-15T14:59:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.713+0000 7f41e6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:58.715 INFO:teuthology.orchestra.run.smithi038.stdout:98784247816 2024-04-15T14:59:58.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.716+0000 7f41f4ea6640 10 librados: watch_flush enter 2024-04-15T14:59:58.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 10 librados: watch_flush exit 2024-04-15T14:59:58.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 20 client.4390.objecter shutdown clearing up homeless session... 2024-04-15T14:59:58.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 10 client.4390.objecter successfully canceled tick 2024-04-15T14:59:58.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 >> v1:172.21.15.38:6800/1608957829 conn(0x7f41d006ee50 legacy=0x7f41d0071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 10 monclient: shutdown 2024-04-15T14:59:58.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:58.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 >> v1:172.21.15.164:6789/0 conn(0x7f41f0140b30 legacy=0x7f41f0138ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 shutdown_connections 2024-04-15T14:59:58.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 >> 172.21.15.38:0/3809779732 conn(0x7f41f0067790 msgr2=0x7f41f00b6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:58.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 shutdown_connections 2024-04-15T14:59:58.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 1 -- 172.21.15.38:0/3809779732 wait complete. 2024-04-15T14:59:58.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.717+0000 7f41f4ea6640 1 librados: shutdown 2024-04-15T14:59:58.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.724+0000 7f96db7fe640 1 -- 172.21.15.38:0/2735561449 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 860207157) 0x7f96d4055230 con 0x7f96e40b57b0 2024-04-15T14:59:58.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.724+0000 7f96db7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-15T14:59:58.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.724+0000 7f96db7fe640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:58.725 INFO:teuthology.orchestra.run.smithi038.stdout:68719476743 2024-04-15T14:59:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.725+0000 7f96e92ce640 10 librados: watch_flush enter 2024-04-15T14:59:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 10 librados: watch_flush exit 2024-04-15T14:59:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 20 client.4408.objecter shutdown clearing up homeless session... 2024-04-15T14:59:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 10 client.4408.objecter successfully canceled tick 2024-04-15T14:59:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 >> v1:172.21.15.38:6800/1608957829 conn(0x7f96c406ed60 legacy=0x7f96c4071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 10 monclient: shutdown 2024-04-15T14:59:58.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:58.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 >> v1:172.21.15.164:6789/0 conn(0x7f96e40b57b0 legacy=0x7f96e41db9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 shutdown_connections 2024-04-15T14:59:58.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 >> 172.21.15.38:0/2735561449 conn(0x7f96e4067790 msgr2=0x7f96e40b79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:58.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 shutdown_connections 2024-04-15T14:59:58.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 1 -- 172.21.15.38:0/2735561449 wait complete. 2024-04-15T14:59:58.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.726+0000 7f96e92ce640 1 librados: shutdown 2024-04-15T14:59:58.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247816 got 98784247816 for osd.3 2024-04-15T14:59:58.734 DEBUG:teuthology.parallel:result is None 2024-04-15T14:59:58.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476743 for osd.1 2024-04-15T14:59:58.739 DEBUG:teuthology.parallel:result is None 2024-04-15T14:59:58.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.743+0000 7f8d5f972640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-15T14:59:58.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.743+0000 7f8d5f972640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-15T14:59:58.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.743+0000 7f8d5f972640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T14:59:58.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.743+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8d58075f00 con 0x7f8d580b5bb0 2024-04-15T14:59:58.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.747+0000 7f8d4dffb640 1 -- 172.21.15.38:0/2450794155 <== mon.2 v1:172.21.15.38:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (unknown 92182286 0 1094436064) 0x7f8d480557f0 con 0x7f8d580b5bb0 2024-04-15T14:59:58.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.747+0000 7f8d4dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-15T14:59:58.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.747+0000 7f8d4dffb640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:58.748 INFO:teuthology.orchestra.run.smithi038.stdout:103079215112 2024-04-15T14:59:58.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 10 librados: watch_flush enter 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 10 librados: watch_flush exit 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 20 client.54317.objecter shutdown clearing up homeless session... 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 10 client.54317.objecter successfully canceled tick 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 >> v1:172.21.15.38:6800/1608957829 conn(0x7f8d3c06edd0 legacy=0x7f8d3c071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 10 monclient: shutdown 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 >> v1:172.21.15.38:6790/0 conn(0x7f8d580b5bb0 legacy=0x7f8d580b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 shutdown_connections 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 >> 172.21.15.38:0/2450794155 conn(0x7f8d58067790 msgr2=0x7f8d580b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 shutdown_connections 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 1 -- 172.21.15.38:0/2450794155 wait complete. 2024-04-15T14:59:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.749+0000 7f8d5f972640 1 librados: shutdown 2024-04-15T14:59:58.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215112 got 103079215112 for osd.2 2024-04-15T14:59:58.762 DEBUG:teuthology.parallel:result is None 2024-04-15T14:59:58.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.918+0000 7fb8ef318640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-15T14:59:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.918+0000 7fb8ef318640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-15T14:59:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.918+0000 7fb8ef318640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:58.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.918+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb8e8075fb0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.950+0000 7fb8ddffb640 1 -- 172.21.15.38:0/990007799 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 3651700234) 0x7fb8d80551b0 con 0x7fb8e80b5b90 2024-04-15T14:59:58.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.950+0000 7fb8ddffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-15T14:59:58.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.950+0000 7fb8ddffb640 10 monclient: _finish_command 2 = system:0 2024-04-15T14:59:58.951 INFO:teuthology.orchestra.run.smithi038.stdout:85899345928 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 10 librados: watch_flush enter 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 10 librados: watch_flush exit 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 20 client.4405.objecter shutdown clearing up homeless session... 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 10 client.4405.objecter successfully canceled tick 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 >> v1:172.21.15.38:6800/1608957829 conn(0x7fb8cc06edd0 legacy=0x7fb8cc071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 10 monclient: shutdown 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 >> v1:172.21.15.164:6789/0 conn(0x7fb8e80b5b90 legacy=0x7fb8e81371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 shutdown_connections 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 >> 172.21.15.38:0/990007799 conn(0x7fb8e8067790 msgr2=0x7fb8e80b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 shutdown_connections 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 1 -- 172.21.15.38:0/990007799 wait complete. 2024-04-15T14:59:58.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:58.952+0000 7fb8ef318640 1 librados: shutdown 2024-04-15T14:59:58.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 85899345927 got 85899345928 for osd.4 2024-04-15T14:59:58.964 DEBUG:teuthology.parallel:result is None 2024-04-15T14:59:58.965 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T14:59:58.965 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T14:59:59.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.069+0000 7f7469643640 10 monclient: get_monmap_and_config 2024-04-15T14:59:59.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.069+0000 7f7469643640 10 monclient: build_initial_monmap 2024-04-15T14:59:59.070 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.069+0000 7f7469643640 10 monclient: monmap: 2024-04-15T14:59:59.071 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:59.071 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.071 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:59.069964+0000 2024-04-15T14:59:59.071 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:59.069964+0000 2024-04-15T14:59:59.071 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:59.072 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.072 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:59.072 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:59.072 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:59.072 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.075 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.069+0000 7f7469643640 1 Processor -- start 2024-04-15T14:59:59.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 1 -- start start 2024-04-15T14:59:59.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 10 monclient: init 2024-04-15T14:59:59.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:59.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T14:59:59.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 10 monclient(hunting): picked mon.noname-b con 0x7f74640b57b0 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:59.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 10 monclient(hunting): picked mon.noname-c con 0x7f74640b5b90 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:59.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 10 monclient(hunting): picked mon.noname-a con 0x7f7464146d70 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:59.076 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7464140ca0 con 0x7f7464146d70 2024-04-15T14:59:59.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74640ab0e0 con 0x7f74640b5b90 2024-04-15T14:59:59.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74640b3310 con 0x7f74640b57b0 2024-04-15T14:59:59.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:59.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.070+0000 7f7469643640 10 monclient(hunting): authenticate will time out at 1459.341186s 2024-04-15T14:59:59.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.071+0000 7f7462ffd640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f74640b57b0 0x7f7464140590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46132/0 (socket says 172.21.15.38:46132) 2024-04-15T14:59:59.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.071+0000 7f7462ffd640 1 -- 172.21.15.38:0/2079280706 learned_addr learned my addr 172.21.15.38:0/2079280706 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:59.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586742416 0 0) 0x7f74640ab0e0 con 0x7f74640b5b90 2024-04-15T14:59:59.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.077 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): my global_id is 4414 2024-04-15T14:59:59.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7450003520 con 0x7f74640b5b90 2024-04-15T14:59:59.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122668443 0 0) 0x7f74640b3310 con 0x7f74640b57b0 2024-04-15T14:59:59.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): my global_id is 54320 2024-04-15T14:59:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74640ab0e0 con 0x7f74640b57b0 2024-04-15T14:59:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010607246 0 0) 0x7f7464140ca0 con 0x7f7464146d70 2024-04-15T14:59:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 10 monclient(hunting): my global_id is 4431 2024-04-15T14:59:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.073+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74640b3310 con 0x7f7464146d70 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.076+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2203918560 0 0) 0x7f7450003520 con 0x7f74640b5b90 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 >> v1:172.21.15.38:6790/0 conn(0x7f74640b57b0 legacy=0x7f7464140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 >> v1:172.21.15.38:6789/0 conn(0x7f7464146d70 legacy=0x7f746414ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 10 monclient: _finish_hunting 0 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 1 monclient: found mon.noname-c 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74640aa460 con 0x7f74640b5b90 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 10 monclient: _finish_auth 0 2024-04-15T14:59:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 10 monclient: _check_auth_tickets 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f7469643640 5 monclient: authenticate success, global_id 4414 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f7469643640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f744c001610 con 0x7f74640b5b90 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f74627fc640 10 monclient: dump: 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.077+0000 7f7469643640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.078+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f744c0018a0 con 0x7f74640b5b90 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.078+0000 7f74627fc640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.078+0000 7f7469643640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.078+0000 7f7469643640 4 set_mon_vals no callback set 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f74627fc640 1 -- 172.21.15.38:0/2079280706 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f744c001c70 con 0x7f74640b5b90 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f74627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f74627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f74627fc640 10 monclient: dump: 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.085 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f7469643640 10 monclient: shutdown 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f7469643640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f7469643640 1 -- 172.21.15.38:0/2079280706 >> v1:172.21.15.164:6789/0 conn(0x7f74640b5b90 legacy=0x7f7464146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f7469643640 1 -- 172.21.15.38:0/2079280706 shutdown_connections 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f7469643640 1 -- 172.21.15.38:0/2079280706 >> 172.21.15.38:0/2079280706 conn(0x7f7464067790 msgr2=0x7f7464067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:59.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f7469643640 1 -- 172.21.15.38:0/2079280706 shutdown_connections 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.079+0000 7f7469643640 1 -- 172.21.15.38:0/2079280706 wait complete. 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.080+0000 7f7469643640 10 monclient: build_initial_monmap 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.080+0000 7f7469643640 10 monclient: monmap: 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.080+0000 7f7469643640 1 librados: starting msgr at 2024-04-15T14:59:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.080+0000 7f7469643640 1 librados: starting objecter 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.080+0000 7f7469643640 1 Processor -- start 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.080+0000 7f7469643640 1 -- start start 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.080+0000 7f7469643640 1 librados: setting wanted keys 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.080+0000 7f7469643640 1 librados: calling monclient init 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.080+0000 7f7469643640 10 monclient: init 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 10 monclient(hunting): picked mon.noname-a con 0x7f74640b57b0 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 10 monclient(hunting): picked mon.noname-c con 0x7f74640b5b90 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 10 monclient(hunting): picked mon.noname-b con 0x7f7464146d70 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7464137b60 con 0x7f74640b57b0 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74641d84f0 con 0x7f7464146d70 2024-04-15T14:59:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74641d9120 con 0x7f74640b5b90 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f7469643640 10 monclient(hunting): authenticate will time out at 1459.351694s 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f745bfff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f74640b5b90 0x7f74641d8a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46138/0 (socket says 172.21.15.38:46138) 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f745bfff640 1 -- 172.21.15.38:0/2700276501 learned_addr learned my addr 172.21.15.38:0/2700276501 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f745b7fe640 10 client.?.objecter ms_handle_connect 0x7f74640b5b90 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.081+0000 7f745b7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.082+0000 7f745b7fe640 10 client.?.objecter ms_handle_connect 0x7f74640b57b0 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.082+0000 7f745b7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.082+0000 7f745b7fe640 10 client.?.objecter ms_handle_connect 0x7f7464146d70 2024-04-15T14:59:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.082+0000 7f745b7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:59.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697656863 0 0) 0x7f74641d9120 con 0x7f74640b5b90 2024-04-15T14:59:59.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): my global_id is 54323 2024-04-15T14:59:59.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7444004eb0 con 0x7f74640b5b90 2024-04-15T14:59:59.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738972514 0 0) 0x7f74641d84f0 con 0x7f7464146d70 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): my global_id is 4417 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74641d9120 con 0x7f7464146d70 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136170565 0 0) 0x7f7464137b60 con 0x7f74640b57b0 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 10 monclient(hunting): my global_id is 4434 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.084+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74641d84f0 con 0x7f74640b57b0 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4235239205 0 0) 0x7f7444004eb0 con 0x7f74640b5b90 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7464137b60 con 0x7f74640b5b90 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f744c001650 con 0x7f74640b5b90 2024-04-15T14:59:59.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): dump: 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1592339036 0 0) 0x7f74641d9120 con 0x7f7464146d70 2024-04-15T14:59:59.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7444004eb0 con 0x7f7464146d70 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f745c001b90 con 0x7f7464146d70 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): dump: 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1682036922 0 0) 0x7f74641d84f0 con 0x7f74640b57b0 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74641d9120 con 0x7f74640b57b0 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f74540018b0 con 0x7f74640b57b0 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.089+0000 7f745b7fe640 10 monclient(hunting): dump: 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.096 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3145791157 0 0) 0x7f7444004eb0 con 0x7f7464146d70 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 >> v1:172.21.15.38:6790/0 conn(0x7f74640b5b90 legacy=0x7f74641d8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 >> v1:172.21.15.38:6789/0 conn(0x7f74640b57b0 legacy=0x7f7464135ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 10 monclient: _finish_hunting 0 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 1 monclient: found mon.b 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74641414e0 con 0x7f7464146d70 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 10 monclient: _finish_auth 0 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 10 monclient: _check_auth_tickets 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f745b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f7469643640 5 monclient: authenticate success, global_id 4417 2024-04-15T14:59:59.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f7469643640 10 monclient: _renew_subs 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f7469643640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7464143ce0 con 0x7f7464146d70 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f7469643640 10 client.4417.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f7469643640 10 monclient: _renew_subs 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f7469643640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f74641356f0 con 0x7f7464146d70 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.092+0000 7f7469643640 1 librados: init done 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.094+0000 7f7469643640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.094+0000 7f7469643640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.094+0000 7f7469643640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:59.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.094+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7464141730 con 0x7f7464146d70 2024-04-15T14:59:59.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.108+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f745c0020a0 con 0x7f7464146d70 2024-04-15T14:59:59.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.108+0000 7f745b7fe640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:59.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.108+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f745c003b10 con 0x7f7464146d70 2024-04-15T14:59:59.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.108+0000 7f745b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:59.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.108+0000 7f745b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:59.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.108+0000 7f745b7fe640 10 monclient: dump: 2024-04-15T14:59:59.109 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.109 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.110 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.110 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.110 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.110 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.110 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.110 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.110 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.110 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.108+0000 7f7461ffb640 4 set_mon_vals no callback set 2024-04-15T14:59:59.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.108+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f745c01a040 con 0x7f7464146d70 2024-04-15T14:59:59.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.109+0000 7f7462ffd640 10 monclient: get_auth_request con 0x7f744406ef60 auth_method 0 2024-04-15T14:59:59.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.109+0000 7f745b7fe640 10 client.4417.objecter ms_handle_connect 0x7f744406ef60 2024-04-15T14:59:59.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.110+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f745c0522d0 con 0x7f7464146d70 2024-04-15T14:59:59.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.110+0000 7f745b7fe640 10 client.4417.objecter ms_dispatch 0x7f7464000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:59.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.110+0000 7f745b7fe640 3 client.4417.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:59.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.110+0000 7f745b7fe640 3 client.4417.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:59.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.111+0000 7f745b7fe640 20 client.4417.objecter dump_active .. 0 homeless 2024-04-15T14:59:59.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.349+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f745c0546d0 con 0x7f7464146d70 2024-04-15T14:59:59.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.349+0000 7f745b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:59.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.349+0000 7f745b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-15T14:59:59.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.532+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7464077050 con 0x7f744406ef60 2024-04-15T14:59:59.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.533+0000 7f745b7fe640 1 -- 172.21.15.38:0/2700276501 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35444 (unknown 2965378022 0 4199344009) 0x7f7464077050 con 0x7f744406ef60 2024-04-15T14:59:59.535 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T14:59:59.535 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-15T14:59:59.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 10 librados: watch_flush enter 2024-04-15T14:59:59.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 10 librados: watch_flush exit 2024-04-15T14:59:59.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 20 client.4417.objecter shutdown clearing up homeless session... 2024-04-15T14:59:59.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 10 client.4417.objecter successfully canceled tick 2024-04-15T14:59:59.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 >> v1:172.21.15.38:6800/1608957829 conn(0x7f744406ef60 legacy=0x7f7444071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 10 monclient: shutdown 2024-04-15T14:59:59.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:59.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 >> v1:172.21.15.164:6789/0 conn(0x7f7464146d70 legacy=0x7f7464134e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 shutdown_connections 2024-04-15T14:59:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 >> 172.21.15.38:0/2700276501 conn(0x7f7464067790 msgr2=0x7f74640b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 shutdown_connections 2024-04-15T14:59:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 1 -- 172.21.15.38:0/2700276501 wait complete. 2024-04-15T14:59:59.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.535+0000 7f7469643640 1 librados: shutdown 2024-04-15T14:59:59.547 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-04-15T14:59:58.714204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218836,"kb_used_data":2632,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755884,"statfs":{"total":773094113280,"available":772870025216,"internally_reserved":0,"allocated":2695168,"data_stored":1453740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.226227"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.247549+0000","last_change":"2024-04-15T14:59:53.315692+0000","last_active":"2024-04-15T14:59:55.247549+0000","last_peered":"2024-04-15T14:59:55.247549+0000","last_clean":"2024-04-15T14:59:55.247549+0000","last_became_active":"2024-04-15T14:59:53.310268+0000","last_became_peered":"2024-04-15T14:59:53.310268+0000","last_unstale":"2024-04-15T14:59:55.247549+0000","last_undegraded":"2024-04-15T14:59:55.247549+0000","last_fullsized":"2024-04-15T14:59:55.247549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:16:52.167819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:54.079581+0000","last_change":"2024-04-15T14:59:53.351131+0000","last_active":"2024-04-15T14:59:54.079581+0000","last_peered":"2024-04-15T14:59:54.079581+0000","last_clean":"2024-04-15T14:59:54.079581+0000","last_became_active":"2024-04-15T14:59:53.319031+0000","last_became_peered":"2024-04-15T14:59:53.319031+0000","last_unstale":"2024-04-15T14:59:54.079581+0000","last_undegraded":"2024-04-15T14:59:54.079581+0000","last_fullsized":"2024-04-15T14:59:54.079581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:02:06.831069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.242691+0000","last_change":"2024-04-15T14:59:53.006767+0000","last_active":"2024-04-15T14:59:55.242691+0000","last_peered":"2024-04-15T14:59:55.242691+0000","last_clean":"2024-04-15T14:59:55.242691+0000","last_became_active":"2024-04-15T14:59:53.001226+0000","last_became_peered":"2024-04-15T14:59:53.001226+0000","last_unstale":"2024-04-15T14:59:55.242691+0000","last_undegraded":"2024-04-15T14:59:55.242691+0000","last_fullsized":"2024-04-15T14:59:55.242691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:24:19.402932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:53.753504+0000","last_change":"2024-04-15T14:59:53.268620+0000","last_active":"2024-04-15T14:59:53.753504+0000","last_peered":"2024-04-15T14:59:53.753504+0000","last_clean":"2024-04-15T14:59:53.753504+0000","last_became_active":"2024-04-15T14:59:53.236225+0000","last_became_peered":"2024-04-15T14:59:53.236225+0000","last_unstale":"2024-04-15T14:59:53.753504+0000","last_undegraded":"2024-04-15T14:59:53.753504+0000","last_fullsized":"2024-04-15T14:59:53.753504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:02:24.955207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.232995+0000","last_change":"2024-04-15T14:59:53.222610+0000","last_active":"2024-04-15T14:59:55.232995+0000","last_peered":"2024-04-15T14:59:55.232995+0000","last_clean":"2024-04-15T14:59:55.232995+0000","last_became_active":"2024-04-15T14:59:53.217062+0000","last_became_peered":"2024-04-15T14:59:53.217062+0000","last_unstale":"2024-04-15T14:59:55.232995+0000","last_undegraded":"2024-04-15T14:59:55.232995+0000","last_fullsized":"2024-04-15T14:59:55.232995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:15.523606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.147522+0000","last_change":"2024-04-15T14:59:52.865828+0000","last_active":"2024-04-15T14:59:55.147522+0000","last_peered":"2024-04-15T14:59:55.147522+0000","last_clean":"2024-04-15T14:59:55.147522+0000","last_became_active":"2024-04-15T14:59:52.828831+0000","last_became_peered":"2024-04-15T14:59:52.828831+0000","last_unstale":"2024-04-15T14:59:55.147522+0000","last_undegraded":"2024-04-15T14:59:55.147522+0000","last_fullsized":"2024-04-15T14:59:55.147522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:49:13.712376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.224886+0000","last_change":"2024-04-15T14:59:52.944781+0000","last_active":"2024-04-15T14:59:55.224886+0000","last_peered":"2024-04-15T14:59:55.224886+0000","last_clean":"2024-04-15T14:59:55.224886+0000","last_became_active":"2024-04-15T14:59:52.908707+0000","last_became_peered":"2024-04-15T14:59:52.908707+0000","last_unstale":"2024-04-15T14:59:55.224886+0000","last_undegraded":"2024-04-15T14:59:55.224886+0000","last_fullsized":"2024-04-15T14:59:55.224886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:51:14.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.237688+0000","last_change":"2024-04-15T14:59:53.285621+0000","last_active":"2024-04-15T14:59:55.237688+0000","last_peered":"2024-04-15T14:59:55.237688+0000","last_clean":"2024-04-15T14:59:55.237688+0000","last_became_active":"2024-04-15T14:59:53.276305+0000","last_became_peered":"2024-04-15T14:59:53.276305+0000","last_unstale":"2024-04-15T14:59:55.237688+0000","last_undegraded":"2024-04-15T14:59:55.237688+0000","last_fullsized":"2024-04-15T14:59:55.237688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:22:32.578057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.197091+0000","last_change":"2024-04-15T14:59:45.003334+0000","last_active":"2024-04-15T14:59:55.197091+0000","last_peered":"2024-04-15T14:59:55.197091+0000","last_clean":"2024-04-15T14:59:55.197091+0000","last_became_active":"2024-04-15T14:59:44.414489+0000","last_became_peered":"2024-04-15T14:59:44.414489+0000","last_unstale":"2024-04-15T14:59:55.197091+0000","last_undegraded":"2024-04-15T14:59:55.197091+0000","last_fullsized":"2024-04-15T14:59:55.197091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_clean_scrub_stamp":"2024-04-15T14:59:36.273099+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:03.807751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":24,"seq":103079215113,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247816,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":78208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313227,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313224,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":480676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":20,"seq":85899345928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":480676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T14:59:59.548 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T14:59:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.650+0000 7fec3ba36640 10 monclient: get_monmap_and_config 2024-04-15T14:59:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.650+0000 7fec3ba36640 10 monclient: build_initial_monmap 2024-04-15T14:59:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.650+0000 7fec3ba36640 10 monclient: monmap: 2024-04-15T14:59:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:59.651 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:59:59.651309+0000 2024-04-15T14:59:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:59:59.651309+0000 2024-04-15T14:59:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T14:59:59.652 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T14:59:59.652 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 1 Processor -- start 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 1 -- start start 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 10 monclient: init 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 10 monclient(hunting): picked mon.noname-c con 0x7fec34072ef0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 10 monclient(hunting): picked mon.noname-a con 0x7fec34140310 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 10 monclient(hunting): picked mon.noname-b con 0x7fec34146660 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec340ab1e0 con 0x7fec34140310 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.651+0000 7fec3ba36640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec341471c0 con 0x7fec34072ef0 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.652+0000 7fec3ba36640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec340aacc0 con 0x7fec34146660 2024-04-15T14:59:59.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.652+0000 7fec3ba36640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:59.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.652+0000 7fec3ba36640 10 monclient(hunting): authenticate will time out at 1459.922423s 2024-04-15T14:59:59.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.652+0000 7fec39fd3640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fec34146660 0x7fec34146ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46150/0 (socket says 172.21.15.38:46150) 2024-04-15T14:59:59.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.652+0000 7fec39fd3640 1 -- 172.21.15.38:0/1532460118 learned_addr learned my addr 172.21.15.38:0/1532460118 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:59.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676548275 0 0) 0x7fec340aacc0 con 0x7fec34146660 2024-04-15T14:59:59.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): my global_id is 54326 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec20003520 con 0x7fec34146660 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455857439 0 0) 0x7fec340ab1e0 con 0x7fec34140310 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): my global_id is 4437 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec340aacc0 con 0x7fec34140310 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3711308485 0 0) 0x7fec341471c0 con 0x7fec34072ef0 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 10 monclient(hunting): my global_id is 4420 2024-04-15T14:59:59.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.655+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec340ab1e0 con 0x7fec34072ef0 2024-04-15T14:59:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1032595968 0 0) 0x7fec340aacc0 con 0x7fec34140310 2024-04-15T14:59:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 >> v1:172.21.15.38:6790/0 conn(0x7fec34146660 legacy=0x7fec34146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 >> v1:172.21.15.164:6789/0 conn(0x7fec34072ef0 legacy=0x7fec340aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 10 monclient: _finish_hunting 0 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 1 monclient: found mon.noname-a 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec340b5430 con 0x7fec34140310 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 10 monclient: _finish_auth 0 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 10 monclient: _check_auth_tickets 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec240015f0 con 0x7fec34140310 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec2bfff640 10 monclient: dump: 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.660 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec3ba36640 5 monclient: authenticate success, global_id 4437 2024-04-15T14:59:59.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.658+0000 7fec3ba36640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T14:59:59.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.660+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec24001850 con 0x7fec34140310 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.660+0000 7fec2bfff640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.660+0000 7fec2bfff640 1 -- 172.21.15.38:0/1532460118 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec24001be0 con 0x7fec34140310 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.660+0000 7fec2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.660+0000 7fec2bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.660+0000 7fec2bfff640 10 monclient: dump: 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.663 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.660+0000 7fec3ba36640 10 monclient: get_monmap_and_config success 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.660+0000 7fec3ba36640 4 set_mon_vals no callback set 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.661+0000 7fec3ba36640 10 monclient: shutdown 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.661+0000 7fec3ba36640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.661+0000 7fec3ba36640 1 -- 172.21.15.38:0/1532460118 >> v1:172.21.15.38:6789/0 conn(0x7fec34140310 legacy=0x7fec34140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.661+0000 7fec3ba36640 1 -- 172.21.15.38:0/1532460118 shutdown_connections 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.661+0000 7fec3ba36640 1 -- 172.21.15.38:0/1532460118 >> 172.21.15.38:0/1532460118 conn(0x7fec340b8c10 msgr2=0x7fec340b9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.661+0000 7fec3ba36640 1 -- 172.21.15.38:0/1532460118 shutdown_connections 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.661+0000 7fec3ba36640 1 -- 172.21.15.38:0/1532460118 wait complete. 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.662+0000 7fec3ba36640 10 monclient: build_initial_monmap 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.662+0000 7fec3ba36640 10 monclient: monmap: 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T14:59:59.664 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T14:59:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T14:59:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T14:59:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T14:59:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T14:59:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T14:59:59.665 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T14:59:59.665 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.662+0000 7fec3ba36640 1 librados: starting msgr at 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.662+0000 7fec3ba36640 1 librados: starting objecter 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.662+0000 7fec3ba36640 1 Processor -- start 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.662+0000 7fec3ba36640 1 -- start start 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.662+0000 7fec3ba36640 1 librados: setting wanted keys 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.662+0000 7fec3ba36640 1 librados: calling monclient init 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.662+0000 7fec3ba36640 10 monclient: init 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 10 monclient: _reopen_session rank -1 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 10 monclient(hunting): picked mon.noname-b con 0x7fec34072ef0 addr v1:172.21.15.164:6789/0 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 10 monclient(hunting): picked mon.noname-a con 0x7fec34140310 addr v1:172.21.15.38:6789/0 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 10 monclient(hunting): picked mon.noname-c con 0x7fec34146660 addr v1:172.21.15.38:6790/0 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec341db7f0 con 0x7fec34140310 2024-04-15T14:59:59.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec340acbe0 con 0x7fec34072ef0 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3413ca10 con 0x7fec34146660 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 10 monclient(hunting): _renew_subs 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec3ba36640 10 monclient(hunting): authenticate will time out at 1459.933608s 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec38fd1640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fec34140310 0x7fec341dbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:56000/0 (socket says 172.21.15.38:56000) 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec39fd3640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fec34146660 0x7fec341d5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46154/0 (socket says 172.21.15.38:46154) 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec38fd1640 1 -- 172.21.15.38:0/4130022056 learned_addr learned my addr 172.21.15.38:0/4130022056 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec29ffb640 10 client.?.objecter ms_handle_connect 0x7fec34146660 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.663+0000 7fec29ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.664+0000 7fec29ffb640 10 client.?.objecter ms_handle_connect 0x7fec34140310 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.664+0000 7fec29ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.664+0000 7fec29ffb640 10 client.?.objecter ms_handle_connect 0x7fec34072ef0 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.664+0000 7fec29ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293104441 0 0) 0x7fec340acbe0 con 0x7fec34072ef0 2024-04-15T14:59:59.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): my global_id is 4423 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec18004eb0 con 0x7fec34072ef0 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417354450 0 0) 0x7fec341db7f0 con 0x7fec34140310 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): my global_id is 4440 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec340acbe0 con 0x7fec34140310 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879206930 0 0) 0x7fec3413ca10 con 0x7fec34146660 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): _negotiate 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T14:59:59.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T14:59:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 10 monclient(hunting): my global_id is 54329 2024-04-15T14:59:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.666+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec341db7f0 con 0x7fec34146660 2024-04-15T14:59:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.670+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3400188259 0 0) 0x7fec18004eb0 con 0x7fec34072ef0 2024-04-15T14:59:59.671 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.670+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec3413ca10 con 0x7fec34072ef0 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.670+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec30001810 con 0x7fec34072ef0 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.670+0000 7fec29ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.670+0000 7fec29ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.670+0000 7fec29ffb640 10 monclient(hunting): dump: 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.672 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.671+0000 7fec29ffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T14:59:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2891076850 0 0) 0x7fec340acbe0 con 0x7fec34140310 2024-04-15T14:59:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec18004eb0 con 0x7fec34140310 2024-04-15T14:59:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec24001ca0 con 0x7fec34140310 2024-04-15T14:59:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T14:59:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 10 monclient(hunting): dump: 2024-04-15T14:59:59.674 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1523719132 0 0) 0x7fec341db7f0 con 0x7fec34146660 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec340acbe0 con 0x7fec34146660 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec2c001c50 con 0x7fec34146660 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T14:59:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.673+0000 7fec29ffb640 10 monclient(hunting): dump: 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.676 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3144517691 0 0) 0x7fec3413ca10 con 0x7fec34072ef0 2024-04-15T14:59:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 >> v1:172.21.15.38:6790/0 conn(0x7fec34146660 legacy=0x7fec341d5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 >> v1:172.21.15.38:6789/0 conn(0x7fec34140310 legacy=0x7fec341dbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T14:59:59.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 10 monclient: _finish_hunting 0 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 1 monclient: found mon.b 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec341dc3e0 con 0x7fec34072ef0 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 10 monclient: _finish_auth 0 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 10 monclient: _check_auth_tickets 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec3ba36640 5 monclient: authenticate success, global_id 4423 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec3ba36640 10 monclient: _renew_subs 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec3ba36640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fec341d4cc0 con 0x7fec34072ef0 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec3ba36640 10 client.4423.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T14:59:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec3ba36640 10 monclient: _renew_subs 2024-04-15T14:59:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec3ba36640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fec3413bd70 con 0x7fec34072ef0 2024-04-15T14:59:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.674+0000 7fec3ba36640 1 librados: init done 2024-04-15T14:59:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.675+0000 7fec3ba36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.675+0000 7fec3ba36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.675+0000 7fec3ba36640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T14:59:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.675+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec34077050 con 0x7fec34072ef0 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.924+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec30003610 con 0x7fec34072ef0 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.924+0000 7fec29ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.924+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fec30003960 con 0x7fec34072ef0 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.924+0000 7fec29ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.924+0000 7fec29ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.924+0000 7fec29ffb640 10 monclient: dump: 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T14:59:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T14:59:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T14:59:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T14:59:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T14:59:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T14:59:59.927 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T14:59:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.924+0000 7fec2b7fe640 4 set_mon_vals no callback set 2024-04-15T14:59:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.925+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fec30019e90 con 0x7fec34072ef0 2024-04-15T14:59:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.926+0000 7fec38fd1640 10 monclient: get_auth_request con 0x7fec1806ef60 auth_method 0 2024-04-15T14:59:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.926+0000 7fec29ffb640 10 client.4423.objecter ms_handle_connect 0x7fec1806ef60 2024-04-15T14:59:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.928+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fec30052040 con 0x7fec34072ef0 2024-04-15T14:59:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.928+0000 7fec29ffb640 10 client.4423.objecter ms_dispatch 0x7fec34000b90 osd_map(28..28 src has 1..28) 2024-04-15T14:59:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.928+0000 7fec29ffb640 3 client.4423.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T14:59:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.928+0000 7fec29ffb640 3 client.4423.objecter handle_osd_map decoding full epoch 28 2024-04-15T14:59:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.928+0000 7fec29ffb640 20 client.4423.objecter dump_active .. 0 homeless 2024-04-15T14:59:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.930+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fec30054440 con 0x7fec34072ef0 2024-04-15T14:59:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.930+0000 7fec29ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T14:59:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T14:59:59.930+0000 7fec29ffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:00:00.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.114+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec341d4e90 con 0x7fec1806ef60 2024-04-15T15:00:00.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.115+0000 7fec29ffb640 1 -- 172.21.15.38:0/4130022056 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35444 (unknown 2965378022 0 4199344009) 0x7fec341d4e90 con 0x7fec1806ef60 2024-04-15T15:00:00.117 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T15:00:00.117 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 10 librados: watch_flush enter 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 10 librados: watch_flush exit 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 20 client.4423.objecter shutdown clearing up homeless session... 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 10 client.4423.objecter successfully canceled tick 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 >> v1:172.21.15.38:6800/1608957829 conn(0x7fec1806ef60 legacy=0x7fec18071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 10 monclient: shutdown 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 >> v1:172.21.15.164:6789/0 conn(0x7fec34072ef0 legacy=0x7fec3413c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 shutdown_connections 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 >> 172.21.15.38:0/4130022056 conn(0x7fec340b8c10 msgr2=0x7fec34146ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:00:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 shutdown_connections 2024-04-15T15:00:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 1 -- 172.21.15.38:0/4130022056 wait complete. 2024-04-15T15:00:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.117+0000 7fec3ba36640 1 librados: shutdown 2024-04-15T15:00:00.129 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-04-15T14:59:58.714204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218836,"kb_used_data":2632,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755884,"statfs":{"total":773094113280,"available":772870025216,"internally_reserved":0,"allocated":2695168,"data_stored":1453740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.226227"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.247549+0000","last_change":"2024-04-15T14:59:53.315692+0000","last_active":"2024-04-15T14:59:55.247549+0000","last_peered":"2024-04-15T14:59:55.247549+0000","last_clean":"2024-04-15T14:59:55.247549+0000","last_became_active":"2024-04-15T14:59:53.310268+0000","last_became_peered":"2024-04-15T14:59:53.310268+0000","last_unstale":"2024-04-15T14:59:55.247549+0000","last_undegraded":"2024-04-15T14:59:55.247549+0000","last_fullsized":"2024-04-15T14:59:55.247549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:16:52.167819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:54.079581+0000","last_change":"2024-04-15T14:59:53.351131+0000","last_active":"2024-04-15T14:59:54.079581+0000","last_peered":"2024-04-15T14:59:54.079581+0000","last_clean":"2024-04-15T14:59:54.079581+0000","last_became_active":"2024-04-15T14:59:53.319031+0000","last_became_peered":"2024-04-15T14:59:53.319031+0000","last_unstale":"2024-04-15T14:59:54.079581+0000","last_undegraded":"2024-04-15T14:59:54.079581+0000","last_fullsized":"2024-04-15T14:59:54.079581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:02:06.831069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.242691+0000","last_change":"2024-04-15T14:59:53.006767+0000","last_active":"2024-04-15T14:59:55.242691+0000","last_peered":"2024-04-15T14:59:55.242691+0000","last_clean":"2024-04-15T14:59:55.242691+0000","last_became_active":"2024-04-15T14:59:53.001226+0000","last_became_peered":"2024-04-15T14:59:53.001226+0000","last_unstale":"2024-04-15T14:59:55.242691+0000","last_undegraded":"2024-04-15T14:59:55.242691+0000","last_fullsized":"2024-04-15T14:59:55.242691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:24:19.402932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:53.753504+0000","last_change":"2024-04-15T14:59:53.268620+0000","last_active":"2024-04-15T14:59:53.753504+0000","last_peered":"2024-04-15T14:59:53.753504+0000","last_clean":"2024-04-15T14:59:53.753504+0000","last_became_active":"2024-04-15T14:59:53.236225+0000","last_became_peered":"2024-04-15T14:59:53.236225+0000","last_unstale":"2024-04-15T14:59:53.753504+0000","last_undegraded":"2024-04-15T14:59:53.753504+0000","last_fullsized":"2024-04-15T14:59:53.753504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:02:24.955207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.232995+0000","last_change":"2024-04-15T14:59:53.222610+0000","last_active":"2024-04-15T14:59:55.232995+0000","last_peered":"2024-04-15T14:59:55.232995+0000","last_clean":"2024-04-15T14:59:55.232995+0000","last_became_active":"2024-04-15T14:59:53.217062+0000","last_became_peered":"2024-04-15T14:59:53.217062+0000","last_unstale":"2024-04-15T14:59:55.232995+0000","last_undegraded":"2024-04-15T14:59:55.232995+0000","last_fullsized":"2024-04-15T14:59:55.232995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:15.523606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.147522+0000","last_change":"2024-04-15T14:59:52.865828+0000","last_active":"2024-04-15T14:59:55.147522+0000","last_peered":"2024-04-15T14:59:55.147522+0000","last_clean":"2024-04-15T14:59:55.147522+0000","last_became_active":"2024-04-15T14:59:52.828831+0000","last_became_peered":"2024-04-15T14:59:52.828831+0000","last_unstale":"2024-04-15T14:59:55.147522+0000","last_undegraded":"2024-04-15T14:59:55.147522+0000","last_fullsized":"2024-04-15T14:59:55.147522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:49:13.712376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.224886+0000","last_change":"2024-04-15T14:59:52.944781+0000","last_active":"2024-04-15T14:59:55.224886+0000","last_peered":"2024-04-15T14:59:55.224886+0000","last_clean":"2024-04-15T14:59:55.224886+0000","last_became_active":"2024-04-15T14:59:52.908707+0000","last_became_peered":"2024-04-15T14:59:52.908707+0000","last_unstale":"2024-04-15T14:59:55.224886+0000","last_undegraded":"2024-04-15T14:59:55.224886+0000","last_fullsized":"2024-04-15T14:59:55.224886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:51:14.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.237688+0000","last_change":"2024-04-15T14:59:53.285621+0000","last_active":"2024-04-15T14:59:55.237688+0000","last_peered":"2024-04-15T14:59:55.237688+0000","last_clean":"2024-04-15T14:59:55.237688+0000","last_became_active":"2024-04-15T14:59:53.276305+0000","last_became_peered":"2024-04-15T14:59:53.276305+0000","last_unstale":"2024-04-15T14:59:55.237688+0000","last_undegraded":"2024-04-15T14:59:55.237688+0000","last_fullsized":"2024-04-15T14:59:55.237688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:22:32.578057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-15T14:59:55.197091+0000","last_change":"2024-04-15T14:59:45.003334+0000","last_active":"2024-04-15T14:59:55.197091+0000","last_peered":"2024-04-15T14:59:55.197091+0000","last_clean":"2024-04-15T14:59:55.197091+0000","last_became_active":"2024-04-15T14:59:44.414489+0000","last_became_peered":"2024-04-15T14:59:44.414489+0000","last_unstale":"2024-04-15T14:59:55.197091+0000","last_undegraded":"2024-04-15T14:59:55.197091+0000","last_fullsized":"2024-04-15T14:59:55.197091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_clean_scrub_stamp":"2024-04-15T14:59:36.273099+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:03.807751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":24,"seq":103079215113,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247816,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":78208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313227,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313224,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":480676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":20,"seq":85899345928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":480676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":82836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:00:00.130 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T15:00:00.130 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-15T15:00:00.130 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-15T15:00:00.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-15T15:00:00.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.233+0000 7f6f2c653640 10 monclient: get_monmap_and_config 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.233+0000 7f6f2c653640 10 monclient: build_initial_monmap 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.234+0000 7f6f2c653640 10 monclient: monmap: 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:00:00.234761+0000 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:00:00.234761+0000 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:00:00.235 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:00:00.236 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.234+0000 7f6f2c653640 1 Processor -- start 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.234+0000 7f6f2c653640 1 -- start start 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.234+0000 7f6f2c653640 10 monclient: init 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 10 monclient: _reopen_session rank -1 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 10 monclient(hunting): picked mon.noname-a con 0x7f6f240aa6d0 addr v1:172.21.15.38:6789/0 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 10 monclient(hunting): picked mon.noname-c con 0x7f6f240ac200 addr v1:172.21.15.164:6789/0 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 10 monclient(hunting): picked mon.noname-b con 0x7f6f240aebe0 addr v1:172.21.15.38:6790/0 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2413dc20 con 0x7f6f240aa6d0 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240addd0 con 0x7f6f240ac200 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240ae0b0 con 0x7f6f240aebe0 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 10 monclient(hunting): _renew_subs 2024-04-15T15:00:00.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2c653640 10 monclient(hunting): authenticate will time out at 1460.505807s 2024-04-15T15:00:00.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2abf0640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f6f240aebe0 0x7f6f2413d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46160/0 (socket says 172.21.15.38:46160) 2024-04-15T15:00:00.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.235+0000 7f6f2abf0640 1 -- 172.21.15.38:0/3690975228 learned_addr learned my addr 172.21.15.38:0/3690975228 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:00:00.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.237+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035802181 0 0) 0x7f6f240addd0 con 0x7f6f240ac200 2024-04-15T15:00:00.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): _negotiate 2024-04-15T15:00:00.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:00:00.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:00:00.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): my global_id is 4426 2024-04-15T15:00:00.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f0c003520 con 0x7f6f240ac200 2024-04-15T15:00:00.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1486556997 0 0) 0x7f6f240ae0b0 con 0x7f6f240aebe0 2024-04-15T15:00:00.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): _negotiate 2024-04-15T15:00:00.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:00:00.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:00:00.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): my global_id is 54332 2024-04-15T15:00:00.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f240addd0 con 0x7f6f240aebe0 2024-04-15T15:00:00.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1806462322 0 0) 0x7f6f2413dc20 con 0x7f6f240aa6d0 2024-04-15T15:00:00.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): _negotiate 2024-04-15T15:00:00.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:00:00.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:00:00.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 10 monclient(hunting): my global_id is 4443 2024-04-15T15:00:00.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.238+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f240ae0b0 con 0x7f6f240aa6d0 2024-04-15T15:00:00.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2703978687 0 0) 0x7f6f0c003520 con 0x7f6f240ac200 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 >> v1:172.21.15.38:6790/0 conn(0x7f6f240aebe0 legacy=0x7f6f2413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 >> v1:172.21.15.38:6789/0 conn(0x7f6f240aa6d0 legacy=0x7f6f240ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 10 monclient: _finish_hunting 0 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 1 monclient: found mon.noname-c 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f240736e0 con 0x7f6f240ac200 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 10 monclient: _finish_auth 0 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 10 monclient: _check_auth_tickets 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f2c653640 5 monclient: authenticate success, global_id 4426 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f2c653640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:00:00.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6f18001610 con 0x7f6f240ac200 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f293ed640 10 monclient: dump: 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:00:00.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.241+0000 7f6f2c653640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:00:00.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.243+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f180018e0 con 0x7f6f240ac200 2024-04-15T15:00:00.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.243+0000 7f6f293ed640 10 monclient: handle_config config(0 keys) 2024-04-15T15:00:00.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.243+0000 7f6f293ed640 1 -- 172.21.15.38:0/3690975228 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6f18001cb0 con 0x7f6f240ac200 2024-04-15T15:00:00.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.243+0000 7f6f293ed640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.243+0000 7f6f293ed640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.243+0000 7f6f293ed640 10 monclient: dump: 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.243+0000 7f6f2c653640 10 monclient: get_monmap_and_config success 2024-04-15T15:00:00.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.243+0000 7f6f2c653640 4 set_mon_vals no callback set 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.244+0000 7f6f2c653640 10 monclient: shutdown 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.244+0000 7f6f2c653640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.244+0000 7f6f2c653640 1 -- 172.21.15.38:0/3690975228 >> v1:172.21.15.164:6789/0 conn(0x7f6f240ac200 legacy=0x7f6f2413ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.244+0000 7f6f2c653640 1 -- 172.21.15.38:0/3690975228 shutdown_connections 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.244+0000 7f6f2c653640 1 -- 172.21.15.38:0/3690975228 >> 172.21.15.38:0/3690975228 conn(0x7f6f24068140 msgr2=0x7f6f240b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.244+0000 7f6f2c653640 1 -- 172.21.15.38:0/3690975228 shutdown_connections 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.244+0000 7f6f2c653640 1 -- 172.21.15.38:0/3690975228 wait complete. 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.244+0000 7f6f2c653640 10 monclient: build_initial_monmap 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.244+0000 7f6f2c653640 10 monclient: monmap: 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:00:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 1 librados: starting msgr at 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 1 librados: starting objecter 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 1 Processor -- start 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 1 -- start start 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 1 librados: setting wanted keys 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 1 librados: calling monclient init 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 10 monclient: init 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 10 monclient: _reopen_session rank -1 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T15:00:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 10 monclient(hunting): picked mon.noname-a con 0x7f6f240aa6d0 addr v1:172.21.15.38:6789/0 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 10 monclient(hunting): picked mon.noname-b con 0x7f6f240ac200 addr v1:172.21.15.164:6789/0 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 10 monclient(hunting): picked mon.noname-c con 0x7f6f240aebe0 addr v1:172.21.15.38:6790/0 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f24072d40 con 0x7f6f240aa6d0 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2411d8b0 con 0x7f6f240ac200 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2411cf00 con 0x7f6f240aebe0 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 10 monclient(hunting): _renew_subs 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.245+0000 7f6f2c653640 10 monclient(hunting): authenticate will time out at 1460.516361s 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.246+0000 7f6f2abf0640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f6f240aebe0 0x7f6f241dff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46174/0 (socket says 172.21.15.38:46174) 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.246+0000 7f6f2abf0640 1 -- 172.21.15.38:0/2790788918 learned_addr learned my addr 172.21.15.38:0/2790788918 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.246+0000 7f6f22ffd640 10 client.?.objecter ms_handle_connect 0x7f6f240aebe0 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.246+0000 7f6f22ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.246+0000 7f6f22ffd640 10 client.?.objecter ms_handle_connect 0x7f6f240aa6d0 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.246+0000 7f6f22ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:00:00.251 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.246+0000 7f6f22ffd640 10 client.?.objecter ms_handle_connect 0x7f6f240ac200 2024-04-15T15:00:00.252 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.246+0000 7f6f22ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363898344 0 0) 0x7f6f2411cf00 con 0x7f6f240aebe0 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): _negotiate 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): my global_id is 54335 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f10004eb0 con 0x7f6f240aebe0 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258006701 0 0) 0x7f6f24072d40 con 0x7f6f240aa6d0 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): _negotiate 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): my global_id is 4446 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f2411cf00 con 0x7f6f240aa6d0 2024-04-15T15:00:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365583299 0 0) 0x7f6f2411d8b0 con 0x7f6f240ac200 2024-04-15T15:00:00.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): _negotiate 2024-04-15T15:00:00.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:00:00.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:00:00.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 10 monclient(hunting): my global_id is 4429 2024-04-15T15:00:00.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.248+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f24072d40 con 0x7f6f240ac200 2024-04-15T15:00:00.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1117146875 0 0) 0x7f6f10004eb0 con 0x7f6f240aebe0 2024-04-15T15:00:00.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f2411d8b0 con 0x7f6f240aebe0 2024-04-15T15:00:00.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6f14001bb0 con 0x7f6f240aebe0 2024-04-15T15:00:00.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:00:00.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:00:00.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): dump: 2024-04-15T15:00:00.255 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:00:00.255 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:00:00.255 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 27105279 0 0) 0x7f6f24072d40 con 0x7f6f240ac200 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f10004eb0 con 0x7f6f240ac200 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6f18001510 con 0x7f6f240ac200 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T15:00:00.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): dump: 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1572735647 0 0) 0x7f6f2411cf00 con 0x7f6f240aa6d0 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f24072d40 con 0x7f6f240aa6d0 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6f1c001830 con 0x7f6f240aa6d0 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:00:00.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.253+0000 7f6f22ffd640 10 monclient(hunting): dump: 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:00:00.258 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:00:00.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1786300808 0 0) 0x7f6f2411d8b0 con 0x7f6f240aebe0 2024-04-15T15:00:00.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 >> v1:172.21.15.164:6789/0 conn(0x7f6f240ac200 legacy=0x7f6f24138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:00:00.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 >> v1:172.21.15.38:6789/0 conn(0x7f6f240aa6d0 legacy=0x7f6f241d46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:00:00.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 10 monclient: _finish_hunting 0 2024-04-15T15:00:00.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 1 monclient: found mon.c 2024-04-15T15:00:00.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:00:00.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2411d0d0 con 0x7f6f240aebe0 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 10 monclient: _finish_auth 0 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 10 monclient: _check_auth_tickets 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f2c653640 5 monclient: authenticate success, global_id 54335 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f2c653640 10 monclient: _renew_subs 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f2c653640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f24139760 con 0x7f6f240aebe0 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f2c653640 10 client.54335.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f2c653640 10 monclient: _renew_subs 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f2c653640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f241d4fe0 con 0x7f6f240aebe0 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.257+0000 7f6f2c653640 1 librados: init done 2024-04-15T15:00:00.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.258+0000 7f6f2c653640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:00:00.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.258+0000 7f6f2c653640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:00:00.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.258+0000 7f6f2c653640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:00:00.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.258+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f24077050 con 0x7f6f240aebe0 2024-04-15T15:00:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.273+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f14004b60 con 0x7f6f240aebe0 2024-04-15T15:00:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.273+0000 7f6f22ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T15:00:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.273+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6f14004eb0 con 0x7f6f240aebe0 2024-04-15T15:00:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.273+0000 7f6f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:00:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.273+0000 7f6f22ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T15:00:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.273+0000 7f6f22ffd640 10 monclient: dump: 2024-04-15T15:00:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:00:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.273+0000 7f6f28bec640 4 set_mon_vals no callback set 2024-04-15T15:00:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.274+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f6f1401b3e0 con 0x7f6f240aebe0 2024-04-15T15:00:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.274+0000 7f6f2a3ef640 10 monclient: get_auth_request con 0x7f6f1006ee20 auth_method 0 2024-04-15T15:00:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.274+0000 7f6f22ffd640 10 client.54335.objecter ms_handle_connect 0x7f6f1006ee20 2024-04-15T15:00:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.275+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7f6f14053520 con 0x7f6f240aebe0 2024-04-15T15:00:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.275+0000 7f6f22ffd640 10 client.54335.objecter ms_dispatch 0x7f6f24000b90 osd_map(28..28 src has 1..28) 2024-04-15T15:00:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.275+0000 7f6f22ffd640 3 client.54335.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T15:00:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.275+0000 7f6f22ffd640 3 client.54335.objecter handle_osd_map decoding full epoch 28 2024-04-15T15:00:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.276+0000 7f6f22ffd640 20 client.54335.objecter dump_active .. 0 homeless 2024-04-15T15:00:00.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.530+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f6f14055920 con 0x7f6f240aebe0 2024-04-15T15:00:00.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.530+0000 7f6f22ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:00:00.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.530+0000 7f6f22ffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:00:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.758+0000 7f6f2c653640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-04-15T15:00:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.758+0000 7f6f2c653640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-04-15T15:00:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.758+0000 7f6f2c653640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:00:00.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.758+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6f240b3840 con 0x7f6f240aebe0 2024-04-15T15:00:00.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.765+0000 7f6f22ffd640 1 -- 172.21.15.38:0/2790788918 <== mon.2 v1:172.21.15.38:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f6f14055220 con 0x7f6f240aebe0 2024-04-15T15:00:00.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.765+0000 7f6f22ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-04-15T15:00:00.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.765+0000 7f6f22ffd640 10 monclient: _finish_command 2 = system:0 2024-04-15T15:00:00.767 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T15:00:00.767 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 10 librados: watch_flush enter 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 10 librados: watch_flush exit 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 20 client.54335.objecter shutdown clearing up homeless session... 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 10 client.54335.objecter successfully canceled tick 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 >> v1:172.21.15.38:6800/1608957829 conn(0x7f6f1006ee20 legacy=0x7f6f100712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 10 monclient: shutdown 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 >> v1:172.21.15.38:6790/0 conn(0x7f6f240aebe0 legacy=0x7f6f241dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 shutdown_connections 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 >> 172.21.15.38:0/2790788918 conn(0x7f6f24068140 msgr2=0x7f6f240b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 shutdown_connections 2024-04-15T15:00:00.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 1 -- 172.21.15.38:0/2790788918 wait complete. 2024-04-15T15:00:00.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:00:00.767+0000 7f6f2c653640 1 librados: shutdown 2024-04-15T15:00:00.780 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-15T15:00:00.780 INFO:teuthology.run_tasks:Running task workunit... 2024-04-15T15:00:00.796 INFO:tasks.workunit:Pulling workunits from ref 87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T15:00:00.797 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-15T15:00:00.797 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-15T15:00:00.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:00:00.812 INFO:teuthology.orchestra.run.smithi038.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-15T15:00:00.813 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-15T15:00:00.868 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-15T15:00:00.868 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-15T15:00:00.924 INFO:tasks.workunit:timeout=6h 2024-04-15T15:00:00.924 INFO:tasks.workunit:cleanup=True 2024-04-15T15:00:00.925 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 87dbfb632e974cb2c28d17423071d2d833b53b29 2024-04-15T15:00:00.979 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-15T15:00:06.710 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:01:44.552 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:06.712 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:01:44.555 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:06.766 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:01:44.610 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:06.767 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:01:44.611 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:06.768 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:01:44.612 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:06.790 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:01:44.580 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:06.792 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:01:44.582 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:06.806 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:01:44.649 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:06.828 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:01:44.619 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:26.752 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:02:04.595 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:26.767 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:02:04.610 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:26.782 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:02:04.624 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:26.806 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:02:04.650 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:26.808 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:02:04.651 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:26.817 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:02:04.608 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:26.818 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:02:04.609 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:26.822 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:02:04.666 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:26.832 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:02:04.623 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:46.767 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:02:24.610 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:46.818 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:02:24.662 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:46.838 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:02:24.681 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:46.867 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:02:24.657 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:46.868 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:02:24.659 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:46.873 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:02:24.717 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:46.877 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:02:24.720 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:46.882 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:02:24.673 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:00:46.890 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:02:24.734 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:06.881 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:02:44.671 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:06.881 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:02:44.672 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:06.895 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:02:44.686 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:06.909 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:02:44.752 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:06.912 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:02:44.756 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:06.933 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:02:44.776 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:06.944 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:02:44.788 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:06.997 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:02:44.841 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:07.018 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:02:44.862 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:17.151 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 95% (11889/12482) Updating files: 96% (11983/12482) Updating files: 97% (12108/12482) Updating files: 98% (12233/12482) Updating files: 99% (12358/12482) Updating files: 100% (12482/12482) Updating files: 100% (12482/12482), done. 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '87dbfb632e974cb2c28d17423071d2d833b53b29'. 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-04-15T15:01:17.304 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-15T15:01:17.305 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-04-15T15:01:17.305 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-15T15:01:17.305 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-04-15T15:01:17.305 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-15T15:01:17.305 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-15T15:01:17.305 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-15T15:01:17.305 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 87dbfb632e9 Merge pull request #56775 from cyx1231st/wip-crimson-osd-report-stats 2024-04-15T15:01:17.306 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-15T15:01:17.368 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-15T15:01:17.370 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T15:01:17.370 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-15T15:01:18.065 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-15T15:01:18.128 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-15T15:01:18.167 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T15:01:18.169 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T15:01:18.169 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-15T15:01:18.209 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T15:01:18.212 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-15T15:01:18.212 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-15T15:01:18.269 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-04-15T15:01:18.270 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-04-15T15:01:18.270 DEBUG:teuthology.orchestra.run.smithi038:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=87dbfb632e974cb2c28d17423071d2d833b53b29 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-04-15T15:01:18.329 INFO:tasks.workunit.client.0.smithi038.stderr:+ parallel=1 2024-04-15T15:01:18.329 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' '' = --serial ']' 2024-04-15T15:01:18.329 INFO:tasks.workunit.client.0.smithi038.stderr:+ crimson=0 2024-04-15T15:01:18.329 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' '' = --crimson ']' 2024-04-15T15:01:18.329 INFO:tasks.workunit.client.0.smithi038.stderr:+ color= 2024-04-15T15:01:18.329 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -t 1 ']' 2024-04-15T15:01:18.329 INFO:tasks.workunit.client.0.smithi038.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-04-15T15:01:18.329 INFO:tasks.workunit.client.0.smithi038.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-15T15:01:18.329 INFO:tasks.workunit.client.0.smithi038.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-15T15:01:18.330 INFO:tasks.workunit.client.0.smithi038.stderr:+ declare -A pids 2024-04-15T15:01:18.330 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.331 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.331 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_aio 2024-04-15T15:01:18.331 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_aio' 2024-04-15T15:01:18.331 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_aio 2024-04-15T15:01:18.331 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.332 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_aio 2024-04-15T15:01:18.332 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40795 2024-04-15T15:01:18.332 INFO:tasks.workunit.client.0.smithi038.stdout:test api_aio on pid 40795 2024-04-15T15:01:18.336 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_aio on pid 40795' 2024-04-15T15:01:18.336 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-04-15T15:01:18.336 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40795 2024-04-15T15:01:18.336 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.336 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.336 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_aio_pp 2024-04-15T15:01:18.336 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_aio_pp' 2024-04-15T15:01:18.337 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_aio_pp 2024-04-15T15:01:18.337 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.337 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.337 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.337 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.337 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.337 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.337 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.337 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.338 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.339 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.339 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.339 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.339 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.339 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.339 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.339 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.339 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_aio_pp 2024-04-15T15:01:18.339 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40802 2024-04-15T15:01:18.340 INFO:tasks.workunit.client.0.smithi038.stdout:test api_aio_pp on pid 40802 2024-04-15T15:01:18.344 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_aio_pp on pid 40802' 2024-04-15T15:01:18.344 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40802 2024-04-15T15:01:18.344 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-04-15T15:01:18.344 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.344 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.344 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_io 2024-04-15T15:01:18.345 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_io' 2024-04-15T15:01:18.345 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_io 2024-04-15T15:01:18.345 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.345 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.345 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.345 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.346 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.346 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.346 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.346 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.346 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.347 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.347 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.347 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.347 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.347 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.347 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.348 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.348 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.348 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.348 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.348 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.348 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.348 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.349 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.349 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.349 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.349 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.349 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.349 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.349 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.350 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.350 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.350 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.350 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.350 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.350 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.350 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.350 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.351 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.351 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.351 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.351 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.351 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.351 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.351 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.351 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.351 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.352 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_io 2024-04-15T15:01:18.352 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40812 2024-04-15T15:01:18.352 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_io on pid 40812' 2024-04-15T15:01:18.352 INFO:tasks.workunit.client.0.smithi038.stdout:test api_io on pid 40812 2024-04-15T15:01:18.359 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40812 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_io_pp 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_io_pp' 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_io_pp 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.360 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.361 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.362 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.362 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.362 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.362 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.362 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.362 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.362 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.362 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.363 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.363 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.363 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.363 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.363 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.363 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.364 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.364 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.364 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.364 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.364 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.364 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.364 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.364 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.365 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.366 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.366 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.366 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.366 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.366 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.366 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.366 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_io_pp 2024-04-15T15:01:18.366 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40824 2024-04-15T15:01:18.366 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_io_pp on pid 40824' 2024-04-15T15:01:18.367 INFO:tasks.workunit.client.0.smithi038.stdout:test api_io_pp on pid 40824 2024-04-15T15:01:18.373 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40824 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_asio 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_asio' 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.374 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_asio 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.375 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.376 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.377 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.378 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.379 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.380 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.381 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.381 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_asio 2024-04-15T15:01:18.381 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40837 2024-04-15T15:01:18.381 INFO:tasks.workunit.client.0.smithi038.stdout:test api_asio on pid 40837 2024-04-15T15:01:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_asio on pid 40837' 2024-04-15T15:01:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40837 2024-04-15T15:01:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-04-15T15:01:18.390 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_list 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_list' 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.391 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_list 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.392 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.393 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.394 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.395 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.396 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.397 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.398 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.398 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.398 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.398 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.398 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.398 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.398 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.398 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.398 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.399 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.400 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.400 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.400 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.400 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40795/exe 2024-04-15T15:01:18.400 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_list 2024-04-15T15:01:18.400 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40854 2024-04-15T15:01:18.400 INFO:tasks.workunit.client.0.smithi038.stdout:test api_list on pid 40854 2024-04-15T15:01:18.409 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_list on pid 40854' 2024-04-15T15:01:18.410 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40854 2024-04-15T15:01:18.410 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.410 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.410 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-04-15T15:01:18.410 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_lock 2024-04-15T15:01:18.410 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.410 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.410 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_lock' 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.411 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.412 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.412 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.412 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.412 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.412 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.412 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.412 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_lock 2024-04-15T15:01:18.412 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.413 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40802/exe 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.414 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.415 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.416 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.417 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.418 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_aio: /' 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.419 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_lock 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_aio.log 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40874 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.420 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_lock on pid 40874' 2024-04-15T15:01:18.421 INFO:tasks.workunit.client.0.smithi038.stdout:test api_lock on pid 40874 2024-04-15T15:01:18.433 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-04-15T15:01:18.433 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40874 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_lock_pp 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.434 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_lock_pp' 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_lock_pp 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.435 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_aio_pp: /' 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.436 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.437 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.438 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.438 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.438 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.438 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.438 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.438 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.439 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.440 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.440 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.440 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.440 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.440 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.440 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.440 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.440 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.440 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.441 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.441 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.441 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.441 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.441 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.441 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.442 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.442 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.442 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.442 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.442 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.442 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.443 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.443 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.443 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.443 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.443 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.444 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.444 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.444 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.444 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.444 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40812/exe 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.445 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.446 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.446 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.446 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.446 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.447 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.447 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.447 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.447 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.448 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.448 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_lock_pp 2024-04-15T15:01:18.448 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.448 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.449 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.449 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.449 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.449 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.449 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.450 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.450 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.450 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40895 2024-04-15T15:01:18.450 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.450 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_lock_pp on pid 40895' 2024-04-15T15:01:18.450 INFO:tasks.workunit.client.0.smithi038.stdout:test api_lock_pp on pid 40895 2024-04-15T15:01:18.463 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.463 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40895 2024-04-15T15:01:18.463 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.463 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.463 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.463 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.464 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_misc 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_misc' 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.465 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.466 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2024-04-15T15:01:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_io.log 2024-04-15T15:01:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.467 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.468 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.469 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.470 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.471 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.471 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.471 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.471 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.471 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.471 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.472 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.473 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.473 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.473 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.473 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.473 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.473 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.473 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.473 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_io: /' 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40824/exe 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_misc 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_misc 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.474 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.475 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.476 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.476 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40920 2024-04-15T15:01:18.476 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.476 INFO:tasks.workunit.client.0.smithi038.stdout:test api_misc on pid 40920 2024-04-15T15:01:18.491 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_misc on pid 40920' 2024-04-15T15:01:18.491 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40920 2024-04-15T15:01:18.491 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.491 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_misc_pp 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.492 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_misc_pp' 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.493 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.494 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.495 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40837/exe 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.496 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_io_pp: /' 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.497 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.498 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_misc_pp 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.499 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.500 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_asio.log 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.501 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.502 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_misc_pp 2024-04-15T15:01:18.502 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.502 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_asio: /' 2024-04-15T15:01:18.502 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40942 2024-04-15T15:01:18.502 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_misc_pp on pid 40942' 2024-04-15T15:01:18.502 INFO:tasks.workunit.client.0.smithi038.stdout:test api_misc_pp on pid 40942 2024-04-15T15:01:18.519 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40942 2024-04-15T15:01:18.519 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.519 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.519 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.519 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.519 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.520 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.521 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_tier_pp 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_tier_pp' 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.522 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_tier_pp 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40854/exe 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.523 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.524 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40874/exe 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.525 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.526 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.527 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_lock: /' 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_list.log 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.528 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.529 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.530 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_lock.log 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40895/exe 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.531 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_list: /' 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.532 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.533 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.534 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.534 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.534 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.534 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.534 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-04-15T15:01:18.534 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_tier_pp 2024-04-15T15:01:18.534 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40983 2024-04-15T15:01:18.534 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_tier_pp on pid 40983' 2024-04-15T15:01:18.534 INFO:tasks.workunit.client.0.smithi038.stdout:test api_tier_pp on pid 40983 2024-04-15T15:01:18.539 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40983 2024-04-15T15:01:18.539 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.539 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.539 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_lock_pp: /' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.540 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_pool 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_pool' 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_pool 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.541 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_pool 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40999 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_pool on pid 40999' 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.542 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.543 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.543 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.543 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.543 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.543 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.543 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.543 INFO:tasks.workunit.client.0.smithi038.stdout:test api_pool on pid 40999 2024-04-15T15:01:18.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.548 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=40999 2024-04-15T15:01:18.548 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.548 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.549 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_snapshots 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_snapshots' 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.550 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_snapshots 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.551 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.552 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.552 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.552 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.552 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.552 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_snapshots 2024-04-15T15:01:18.552 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.552 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41019 2024-04-15T15:01:18.552 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_snapshots on pid 41019' 2024-04-15T15:01:18.552 INFO:tasks.workunit.client.0.smithi038.stdout:test api_snapshots on pid 41019 2024-04-15T15:01:18.559 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41019 2024-04-15T15:01:18.559 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.559 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.559 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-04-15T15:01:18.559 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.559 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.560 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.561 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.562 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_snapshots_pp 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_snapshots_pp' 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_snapshots_pp 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.563 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.564 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.565 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.565 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_snapshots_pp 2024-04-15T15:01:18.565 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.565 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.565 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41041 2024-04-15T15:01:18.565 INFO:tasks.workunit.client.0.smithi038.stdout:test api_snapshots_pp on pid 41041 2024-04-15T15:01:18.584 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_snapshots_pp on pid 41041' 2024-04-15T15:01:18.584 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41041 2024-04-15T15:01:18.584 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.584 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.584 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.585 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.586 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_stat 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_stat' 2024-04-15T15:01:18.587 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.588 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.589 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.590 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.591 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.592 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40920/exe 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.593 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40942/exe 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.594 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_stat 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.595 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.596 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.597 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_misc_pp: /' 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2024-04-15T15:01:18.598 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.599 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.600 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.601 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.601 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.601 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_misc.log 2024-04-15T15:01:18.601 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_misc: /' 2024-04-15T15:01:18.601 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.601 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_stat 2024-04-15T15:01:18.601 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41097 2024-04-15T15:01:18.601 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_stat on pid 41097' 2024-04-15T15:01:18.601 INFO:tasks.workunit.client.0.smithi038.stdout:test api_stat on pid 41097 2024-04-15T15:01:18.615 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41097 2024-04-15T15:01:18.615 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.615 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.615 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_stat_pp 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_stat_pp' 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_stat_pp 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.616 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.617 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.618 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.619 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40983/exe 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.620 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.621 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_tier_pp.xml 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.622 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_tier_pp: /' 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.623 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.624 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.625 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.626 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_stat_pp 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41134 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_stat_pp on pid 41134' 2024-04-15T15:01:18.627 INFO:tasks.workunit.client.0.smithi038.stdout:test api_stat_pp on pid 41134 2024-04-15T15:01:18.630 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41134 2024-04-15T15:01:18.630 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.630 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.630 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_watch_notify 2024-04-15T15:01:18.630 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-04-15T15:01:18.630 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_watch_notify' 2024-04-15T15:01:18.630 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.630 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.630 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.631 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_watch_notify 2024-04-15T15:01:18.632 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.632 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_watch_notify 2024-04-15T15:01:18.632 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.632 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41144 2024-04-15T15:01:18.632 INFO:tasks.workunit.client.0.smithi038.stdout:test api_watch_notify on pid 41144 2024-04-15T15:01:18.638 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_watch_notify on pid 41144' 2024-04-15T15:01:18.638 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41144 2024-04-15T15:01:18.638 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.638 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.638 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.638 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.638 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.639 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_watch_notify_pp 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_watch_notify_pp' 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_watch_notify_pp 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.640 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.641 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.642 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.643 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.643 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.643 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.643 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.643 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.643 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_watch_notify_pp 2024-04-15T15:01:18.643 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41158 2024-04-15T15:01:18.643 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_watch_notify_pp on pid 41158' 2024-04-15T15:01:18.643 INFO:tasks.workunit.client.0.smithi038.stdout:test api_watch_notify_pp on pid 41158 2024-04-15T15:01:18.652 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41158 2024-04-15T15:01:18.652 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.652 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_cmd 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_cmd' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.653 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.654 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.655 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.656 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.657 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.658 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_cmd 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41019/exe 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.659 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.660 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.660 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.660 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_cmd 2024-04-15T15:01:18.660 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41174 2024-04-15T15:01:18.660 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_cmd on pid 41174' 2024-04-15T15:01:18.660 INFO:tasks.workunit.client.0.smithi038.stdout:test api_cmd on pid 41174 2024-04-15T15:01:18.681 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41174 2024-04-15T15:01:18.681 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.682 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41041/exe 2024-04-15T15:01:18.683 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.684 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_cmd_pp 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_cmd_pp' 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.685 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_cmd_pp 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_snapshots: /' 2024-04-15T15:01:18.686 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.687 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.688 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.689 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41097/exe 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.690 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2024-04-15T15:01:18.691 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.692 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.693 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.694 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/40999/exe 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.695 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_stat.log 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_stat: /' 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.696 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.697 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.698 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41158/exe 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.699 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_cmd_pp 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41225 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_cmd_pp on pid 41225' 2024-04-15T15:01:18.700 INFO:tasks.workunit.client.0.smithi038.stdout:test api_cmd_pp on pid 41225 2024-04-15T15:01:18.706 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41225 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_service 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.707 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_service' 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.708 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.709 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.710 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.710 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.710 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_service 2024-04-15T15:01:18.710 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_service 2024-04-15T15:01:18.710 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41240 2024-04-15T15:01:18.710 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_service on pid 41240' 2024-04-15T15:01:18.710 INFO:tasks.workunit.client.0.smithi038.stdout:test api_service on pid 41240 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41240 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_service_pp 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_service_pp' 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.718 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.719 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41144/exe 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-04-15T15:01:18.720 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_pool.log 2024-04-15T15:01:18.721 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_pool: /' 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_service_pp 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.722 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.723 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_service_pp 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41265 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_service_pp on pid 41265' 2024-04-15T15:01:18.724 INFO:tasks.workunit.client.0.smithi038.stdout:test api_service_pp on pid 41265 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41265 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_c_write_operations 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.732 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.733 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_c_write_operations' 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.734 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_watch_notify: /' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.735 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.736 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_c_write_operations 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.737 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.738 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.738 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.738 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_c_write_operations 2024-04-15T15:01:18.738 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.738 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.738 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41292 2024-04-15T15:01:18.738 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_c_write_operations on pid 41292' 2024-04-15T15:01:18.738 INFO:tasks.workunit.client.0.smithi038.stdout:test api_c_write_operations on pid 41292 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41292 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.749 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.750 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.751 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_c_read_operations 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_c_read_operations' 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.752 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_c_read_operations 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.753 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.754 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.755 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.756 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_c_read_operations 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41323 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_c_read_operations on pid 41323' 2024-04-15T15:01:18.757 INFO:tasks.workunit.client.0.smithi038.stdout:test api_c_read_operations on pid 41323 2024-04-15T15:01:18.783 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41323 2024-04-15T15:01:18.783 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.783 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.783 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.783 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.783 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.783 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41134/exe 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.784 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.785 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.786 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_stat_pp: /' 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.787 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.788 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.789 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.790 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.791 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41240/exe 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.792 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.793 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s api_cls_remote_reads 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41225/exe 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.794 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_service.log 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.795 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.796 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.797 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.798 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_service: /' 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.799 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.800 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.801 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' api_cls_remote_reads' 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.802 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41174/exe 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo api_cls_remote_reads 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.803 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.804 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.805 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.805 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=api_cls_remote_reads 2024-04-15T15:01:18.805 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.805 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.805 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.805 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41383 2024-04-15T15:01:18.805 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test api_cls_remote_reads on pid 41383' 2024-04-15T15:01:18.805 INFO:tasks.workunit.client.0.smithi038.stdout:test api_cls_remote_reads on pid 41383 2024-04-15T15:01:18.816 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41383 2024-04-15T15:01:18.816 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.816 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.816 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.816 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.816 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.816 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.816 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.816 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.817 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_cmd: /' 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41265/exe 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.818 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.819 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-04-15T15:01:18.820 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_service_pp: /' 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2024-04-15T15:01:18.821 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s list_parallel 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.822 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' list_parallel' 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2024-04-15T15:01:18.823 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo list_parallel 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_cmd.log 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.824 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.825 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.825 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.825 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.825 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.825 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.825 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=list_parallel 2024-04-15T15:01:18.825 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41412 2024-04-15T15:01:18.825 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test list_parallel on pid 41412' 2024-04-15T15:01:18.825 INFO:tasks.workunit.client.0.smithi038.stdout:test list_parallel on pid 41412 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41412 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.838 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s open_pools_parallel 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.839 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' open_pools_parallel' 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.840 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.841 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41323/exe 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.842 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.843 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.844 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-04-15T15:01:18.845 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo open_pools_parallel 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.846 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.847 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41383/exe 2024-04-15T15:01:18.848 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.848 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=open_pools_parallel 2024-04-15T15:01:18.848 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41448 2024-04-15T15:01:18.848 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test open_pools_parallel on pid 41448' 2024-04-15T15:01:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:test open_pools_parallel on pid 41448 2024-04-15T15:01:18.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41448 2024-04-15T15:01:18.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-15T15:01:18.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.853 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.853 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.853 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s delete_pools_parallel 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' delete_pools_parallel' 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.854 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo delete_pools_parallel 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cls_remote_reads.xml 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41292/exe 2024-04-15T15:01:18.855 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=delete_pools_parallel 2024-04-15T15:01:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2024-04-15T15:01:18.857 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41476 2024-04-15T15:01:18.857 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-04-15T15:01:18.857 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test delete_pools_parallel on pid 41476' 2024-04-15T15:01:18.857 INFO:tasks.workunit.client.0.smithi038.stdout:test delete_pools_parallel on pid 41476 2024-04-15T15:01:18.873 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41476 2024-04-15T15:01:18.873 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:18.873 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.873 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-04-15T15:01:18.873 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.873 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.873 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.873 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.874 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.875 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.876 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.877 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s cls 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' cls' 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.878 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.879 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo cls 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.880 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=cls 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.881 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41572 2024-04-15T15:01:18.882 INFO:tasks.workunit.client.0.smithi038.stdout:test cls on pid 41572 2024-04-15T15:01:18.894 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test cls on pid 41572' 2024-04-15T15:01:18.894 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41572 2024-04-15T15:01:18.894 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:18.894 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.894 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.894 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.895 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.896 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.897 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.898 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.899 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s cmd 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' cmd' 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.900 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.901 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo cmd 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.902 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.903 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.904 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.905 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=cmd 2024-04-15T15:01:18.905 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.905 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.905 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41612 2024-04-15T15:01:18.905 INFO:tasks.workunit.client.0.smithi038.stdout:test cmd on pid 41612 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test cmd on pid 41612' 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41612 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.917 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s handler_error 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' handler_error' 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.918 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41476/exe 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo handler_error 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.919 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.920 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.921 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.922 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-04-15T15:01:18.922 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=handler_error 2024-04-15T15:01:18.922 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41640 2024-04-15T15:01:18.922 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test handler_error on pid 41640' 2024-04-15T15:01:18.922 INFO:tasks.workunit.client.0.smithi038.stdout:test handler_error on pid 41640 2024-04-15T15:01:18.931 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41640 2024-04-15T15:01:18.931 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:18.931 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.931 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.931 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.931 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.931 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.931 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.932 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.933 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s io 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.934 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' io' 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.935 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41448/exe 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.936 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.937 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.938 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo io 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [----------] Global test environment set-up. 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [----------] 12 tests from AsioRados 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.621+0000 7fab8bf56780 10 monclient: get_monmap_and_config 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.621+0000 7fab8bf56780 10 monclient: build_initial_monmap 2024-04-15T15:01:18.939 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.621+0000 7fab8bf56780 10 monclient: monmap: 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: epoch 0 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: last_changed 0.000000 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: created 0.000000 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: min_mon_release 0 (unknown) 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: election_strategy: 1 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.622+0000 7fab8bf56780 1 Processor -- start 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.623+0000 7fab8bf56780 1 -- start start 2024-04-15T15:01:18.940 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.623+0000 7fab8bf56780 10 monclient: init 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 10 monclient: _reopen_session rank -1 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 10 monclient(hunting): picked mon.noname-b con 0x565390112610 addr v1:172.21.15.164:6789/0 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 10 monclient(hunting): picked mon.noname-a con 0x565390113c70 addr v1:172.21.15.38:6789/0 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 10 monclient(hunting): picked mon.noname-c con 0x5653901a71a0 addr v1:172.21.15.38:6790/0 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x565390241fe0 con 0x565390113c70 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5653901a4dc0 con 0x565390112610 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5653901a89a0 con 0x5653901a71a0 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 10 monclient(hunting): _renew_subs 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.625+0000 7fab8bf56780 10 monclient(hunting): authenticate will time out at 1538.895994s 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.642+0000 7fab89a59640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x565390112610 0x5653902411c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:38774/0 (socket says 172.21.15.38:38774) 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.642+0000 7fab89a59640 1 -- 172.21.15.38:0/1178847846 learned_addr learned my addr 172.21.15.38:0/1178847846 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.680+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230426719 0 0) 0x5653901a4dc0 con 0x565390112610 2024-04-15T15:01:18.941 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.680+0000 7fab88a57640 10 monclient(hunting): _negotiate 2024-04-15T15:01:18.942 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.680+0000 7fab88a57640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:01:18.942 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.680+0000 7fab88a57640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:01:18.942 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.680+0000 7fab88a57640 10 monclient(hunting): my global_id is 4486 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.945 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.946 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=io 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41671 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test io on pid 41671' 2024-04-15T15:01:18.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.680+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 --> v1:172.21.test io on pid 41671 2024-04-15T15:01:18.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41671 2024-04-15T15:01:18.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:18.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.958 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.958 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s ec_io 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.960 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' ec_io' 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.961 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo ec_io 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.962 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.963 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.964 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.965 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.966 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.967 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.968 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.968 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41412/exe 2024-04-15T15:01:18.968 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=ec_io 2024-04-15T15:01:18.968 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.968 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.968 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41706 2024-04-15T15:01:18.968 INFO:tasks.workunit.client.0.smithi038.stdout:test ec_io on pid 41706 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test ec_io on pid 41706' 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41706 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.986 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.987 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.988 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:18.989 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.990 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s list 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' list' 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:18.991 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41612/exe 2024-04-15T15:01:18.992 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41572/exe 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:18.993 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.994 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.995 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ list_parallel: /' 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_cls 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_rados_list_parallel.log 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_cmd 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:18.996 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.997 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_cls.log 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ cls: /' 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo list 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:18.998 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_cmd.log 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ cmd: /' 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:18.999 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.000 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.000 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.000 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.000 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.000 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.000 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=list 2024-04-15T15:01:19.000 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41757 2024-04-15T15:01:19.000 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test list on pid 41757' 2024-04-15T15:01:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:test list on pid 41757 2024-04-15T15:01:19.003 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41757 2024-04-15T15:01:19.003 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:19.003 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:19.003 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-04-15T15:01:19.003 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:19.003 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:19.003 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:19.003 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.003 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s ec_list 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.004 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' ec_list' 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab6c001e10 con 0x565390112610 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.688+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957480446 0 0) 0x5653901a89a0 con 0x5653901a71a0 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.688+0000 7fab88a57640 10 monclient(hunting): _negotiate 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.688+0000 7fab88a57640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.688+0000 7fab88a57640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:01:19.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.688+0000 7fab88a57640 10 monclient(hunting): my global_id is 54386 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.688+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5653901a4dc0 con 0x5653901a71a0 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.718+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585586951 0 0) 0x565390241fe0 con 0x565390113c70 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.718+0000 7fab88a57640 10 monclient(hunting): _negotiate 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.718+0000 7fab88a57640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.718+0000 7fab88a57640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.718+0000 7fab88a57640 10 monclient(hunting): my global_id is 4509 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.718+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5653901a89a0 con 0x565390113c70 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.730+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4136420985 0 0) 0x7fab6c001e10 con 0x565390112610 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.730+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 >> v1:172.21.15.38:6790/0 conn(0x5653901a71a0 legacy=0x565390249710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.730+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 >> v1:172.21.15.38:6789/0 conn(0x565390113c70 legacy=0x5653902418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.730+0000 7fab88a57640 10 monclient: _finish_hunting 0 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.730+0000 7fab88a57640 1 monclient: found mon.noname-b 2024-04-15T15:01:19.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.730+0000 7fab88a57640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:01:19.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.730+0000 7fab88a57640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.164:6789/0 2024-04-15T15:01:19.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.730+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653901167f0 con 0x565390112610 2024-04-15T15:01:19.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.731+0000 7fab88a57640 10 monclient: _finish_auth 0 2024-04-15T15:01:19.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.731+0000 7fab88a57640 10 monclient: _check_auth_tickets 2024-04-15T15:01:19.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.731+0000 7fab88a57640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:19.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.731+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fab7c0015f0 con 0x565390112610 2024-04-15T15:01:19.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.731+0000 7fab88a57640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:01:19.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.731+0000 7fab88a57640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:01:19.017 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.017 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.017 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.017 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.018 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.019 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.020 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41640/exe 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.021 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:19.022 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo ec_list 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_handler_error.log 2024-04-15T15:01:19.023 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_handler_error 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=ec_list 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.024 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41785 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test ec_list on pid 41785' 2024-04-15T15:01:19.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2test ec_list on pid 41785 2024-04-15T15:01:19.035 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41785 2024-04-15T15:01:19.035 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ handler_error: /' 2024-04-15T15:01:19.035 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:19.035 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41706/exe 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:19.036 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s misc 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' misc' 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:19.037 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.038 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.039 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_ec_io.log 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo misc 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_ec_io 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ ec_io: /' 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:19.040 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.041 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41671/exe 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.042 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=misc 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41853 2024-04-15T15:01:19.043 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test misc on pid 41853' 2024-04-15T15:01:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:test misc on pid 41853 2024-04-15T15:01:19.050 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41853 2024-04-15T15:01:19.050 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:19.050 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:19.050 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.050 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:19.050 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.050 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.050 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_io 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.051 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s pool 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' pool' 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ io: /' 2024-04-15T15:01:19.052 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_io.log 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo pool 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:19.053 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:19.054 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=pool 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41876 2024-04-15T15:01:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:test pool on pid 41876 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test pool on pid 41876' 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41876 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.057 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:024-04-15T15:01:18.731+0000 7fab88a57640 10 monclient: dump: 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: epoch 1 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: min_mon_release 19 (squid) 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: election_strategy: 3 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:01:19.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.731+0000 7fab8bf56780 5 monclient: authenticate success, global_id 4486 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.731+0000 7fab8bf56780 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.779+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab7c001850 con 0x565390112610 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.779+0000 7fab88a57640 10 monclient: handle_config config(0 keys) 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.779+0000 7fab88a57640 1 -- 172.21.15.38:0/1178847846 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fab7c001c20 con 0x565390112610 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.779+0000 7fab88a57640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.779+0000 7fab88a57640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.779+0000 7fab88a57640 10 monclient: dump: 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: epoch 1 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: min_mon_release 19 (squid) 2024-04-15T15:01:19.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: election_strategy: 3 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.779+0000 7fab8bf56780 10 monclient: get_monmap_and_config success 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.779+0000 7fab8bf56780 4 set_mon_vals no callback set 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.780+0000 7fab8bf56780 10 monclient: shutdown 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.780+0000 7fab8bf56780 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.780+0000 7fab8bf56780 1 -- 172.21.15.38:0/1178847846 >> v1:172.21.15.164:6789/0 conn(0x565390112610 legacy=0x5653902411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.780+0000 7fab8bf56780 1 -- 172.21.15.38:0/1178847846 shutdown_connections 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.780+0000 7fab8bf56780 1 -- 172.21.15.38:0/1178847846 >> 172.21.15.38:0/1178847846 conn(0x56539011c380 msgr2=0x5653901a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.780+0000 7fab8bf56780 1 -- 172.21.15.38:0/1178847846 shutdown_connections 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.780+0000 7fab8bf56780 1 -- 172.21.15.38:0/1178847846 wait complete. 2024-04-15T15:01:19.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.780+0000 7fab8bf56780 10 monclient: build_initial_monmap 2024-04-15T15:01:19.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.780+0000 7fab8bf56780 10 monclient: monmap: 2024-04-15T15:01:19.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: epoch 0 2024-04-15T15:01:19.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:01:19.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: last_changed 0.000000 2024-04-15T15:01:19.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: created 0.000000 2024-04-15T15:01:19.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: min_mon_release 0 (unknown) 2024-04-15T15:01:19.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: election_strategy: 1 2024-04-15T15:01:19.065 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s read_operations 2024-04-15T15:01:19.065 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' read_operations' 2024-04-15T15:01:19.065 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo read_operations 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:19.066 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.067 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.068 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=read_operations 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41898 2024-04-15T15:01:19.069 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 0: v1:172.21.15.38:6789/0 mon.nonamtest read_operations on pid 41898 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test read_operations on pid 41898' 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41898 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s snapshots 2024-04-15T15:01:19.078 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' snapshots' 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.079 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.080 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:19.081 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.082 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41757/exe 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:19.083 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo snapshots 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:19.084 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=snapshots 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41914 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.085 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test snapshots on pid 41914' 2024-04-15T15:01:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:test snapshots on pid 41914 2024-04-15T15:01:19.098 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41914 2024-04-15T15:01:19.098 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:19.098 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:19.098 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.098 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.098 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.098 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.098 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.098 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_list 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s watch_notify 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.099 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' watch_notify' 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ list: /' 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:19.100 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41785/exe 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_list.log 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:19.101 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo watch_notify 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.102 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.103 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ ec_list: /' 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_ec_list.log 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.104 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_ec_list 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.105 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:19.106 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.107 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=watch_notify 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41948 2024-04-15T15:01:19.108 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:test watch_notify on pid 41948 2024-04-15T15:01:19.119 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test watch_notify on pid 41948' 2024-04-15T15:01:19.119 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41948 2024-04-15T15:01:19.119 INFO:tasks.workunit.client.0.smithi038.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-15T15:01:19.119 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:19.119 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:19.119 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-04-15T15:01:19.119 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:19.119 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.119 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:++ printf %25s write_operations 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:+ r=' write_operations' 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.120 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.121 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:++ echo write_operations 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:++ awk '{print $1}' 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.122 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.123 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.124 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:19.125 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41853/exe 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.126 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:19.127 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:+ ff=write_operations 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41976 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo 'test write_operations on pid 41976' 2024-04-15T15:01:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:test write_operations on pid 41976 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:+ pids[$f]=41976 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:+ ret=0 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' 1 -eq 1 ']' 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40983 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40983 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41876/exe 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-04-15T15:01:19.158 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.159 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -f /etc/bashrc ']' 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:+ . /etc/bashrc 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:19.160 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -z '' ']' 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ BASHRCSOURCED=Y 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ shopt -q login_shell 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.161 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:+++ umask 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' 0022 -eq 0 ']' 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:++ SHELL=/bin/bash 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.162 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/bash_completion.sh 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/cobbler.sh 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.163 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorgrep.sh 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_misc 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_misc.log 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.164 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ misc: /' 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:19.165 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.166 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'grep=grep --color=auto' 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'egrep=egrep --color=auto' 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-04-15T15:01:19.167 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorls.sh 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' '!' -t 0 ']' 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:+++ return 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export S_COLORS=auto 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:+++ S_COLORS=auto 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-04-15T15:01:19.168 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_pool 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_pool.log 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ pool: /' 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.169 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.170 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:+++ /usr/libexec/grepconf.sh -c 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.171 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41914/exe 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:19.172 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.173 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.174 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.175 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/debuginfod.sh 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.176 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/gawk.sh 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41898/exe 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/lang.sh 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_snapshots 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/locale 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_snapshots.log 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ snapshots: /' 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.177 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.178 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_read_operations 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ read_operations: /' 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.179 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_read_operations.log 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG_backup=en_US.UTF-8 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.180 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /etc/locale.conf ']' 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -x /usr/bin/sed ']' 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41976/exe 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:++++ export LANG=en_US.UTF-8 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:++++ LANG=en_US.UTF-8 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++ LANG=en_US.UTF-8 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++ unset LANG_backup config 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n '' ']' 2024-04-15T15:01:19.181 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' dumb = linux ']' 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/less.sh 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:++ for i in /etc/profile.d/*.sh 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.182 INFO:tasks.workunit.client.0.smithi038.stderr:++ '[' '' ']' 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:++ . /etc/profile.d/which2.sh 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+++++ readlink /proc/41948/exe 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ write_operations: /' 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:++++ basename /usr/bin/bash 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_write_operations.log 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_declare='declare -f' 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+++ which_opt=-f 2024-04-15T15:01:19.183 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export which_declare 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:+++ export -f which 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset i 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:++ unset -f pathmunge 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:+ export PATH 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:+ unset rc 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_watch_notify 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:+ sed 's/^/ watch_notify: /' 2024-04-15T15:01:19.184 INFO:tasks.workunit.client.0.smithi038.stderr:+ ceph_test_neorados_write_operations 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout:e-a 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.781+0000 7fab8bf56780 1 librados: starting msgr at 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.781+0000 7fab8bf56780 1 librados: starting objecter 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.781+0000 7fab8bf56780 1 Processor -- start 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.781+0000 7fab8bf56780 1 -- start start 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.781+0000 7fab8bf56780 1 librados: setting wanted keys 2024-04-15T15:01:19.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.781+0000 7fab8bf56780 1 librados: calling monclient init 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.781+0000 7fab8bf56780 10 monclient: init 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 10 monclient: _reopen_session rank -1 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 10 monclient(hunting): picked mon.noname-a con 0x565390112610 addr v1:172.21.15.38:6789/0 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 10 monclient(hunting): picked mon.noname-b con 0x565390113c70 addr v1:172.21.15.164:6789/0 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 10 monclient(hunting): picked mon.noname-c con 0x5653901a71a0 addr v1:172.21.15.38:6790/0 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56539023f450 con 0x565390112610 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5653900dd640 con 0x565390113c70 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56539023efc0 con 0x5653901a71a0 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 10 monclient(hunting): _renew_subs 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.782+0000 7fab8bf56780 10 monclient(hunting): authenticate will time out at 1539.052907s 2024-04-15T15:01:19.186 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.834+0000 7fab8a25a640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x5653901a71a0 0x565390241920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:46870/0 (socket says 172.21.15.38:46870) 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.834+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 learned_addr learned my addr 172.21.15.38:0/443484706 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.868+0000 7fab82ffd640 10 client.?.objecter ms_handle_connect 0x5653901a71a0 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.868+0000 7fab82ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.925+0000 7fab82ffd640 10 client.?.objecter ms_handle_connect 0x565390113c70 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.925+0000 7fab82ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.971+0000 7fab82ffd640 10 client.?.objecter ms_handle_connect 0x565390112610 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.971+0000 7fab82ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.987+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982496533 0 0) 0x56539023efc0 con 0x5653901a71a0 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.987+0000 7fab82ffd640 10 monclient(hunting): _negotiate 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.987+0000 7fab82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.987+0000 7fab82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.987+0000 7fab82ffd640 10 monclient(hunting): my global_id is 54467 2024-04-15T15:01:19.187 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:18.987+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab6c001a50 con 0x5653901a71a0 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.003+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371228431 0 0) 0x5653900dd640 con 0x565390113c70 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.003+0000 7fab82ffd640 10 monclient(hunting): _negotiate 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.003+0000 7fab82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.003+0000 7fab82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.003+0000 7fab82ffd640 10 monclient(hunting): my global_id is 4585 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.003+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x56539023efc0 con 0x565390113c70 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.065+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2045533396 0 0) 0x56539023efc0 con 0x565390113c70 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.065+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5653900dd640 con 0x565390113c70 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.065+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fab74001510 con 0x565390113c70 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.065+0000 7fab82ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.065+0000 7fab82ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.065+0000 7fab82ffd640 10 monclient(hunting): dump: 2024-04-15T15:01:19.188 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: epoch 1 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: min_mon_release 19 (squid) 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: election_strategy: 3 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.065+0000 7fab82ffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.066+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441037263 0 0) 0x56539023f450 con 0x565390112610 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.066+0000 7fab82ffd640 10 monclient(hunting): _negotiate 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.066+0000 7fab82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:01:19.189 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.066+0000 7fab82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:01:19.190 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.066+0000 7fab82ffd640 10 monclient(hunting): my global_id is 4596 2024-04-15T15:01:19.190 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.066+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x56539023efc0 con 0x565390112610 2024-04-15T15:01:19.190 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 343641762 0 0) 0x5653900dd640 con 0x565390113c70 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 >> v1:172.21.15.38:6790/0 conn(0x5653901a71a0 legacy=0x565390241920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 >> v1:172.21.15.38:6789/0 conn(0x565390112610 legacy=0x565390199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 10 monclient: _finish_hunting 0 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 1 monclient: found mon.b 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56539023f190 con 0x565390113c70 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 10 monclient: _finish_auth 0 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 10 monclient: _check_auth_tickets 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 5 monclient: authenticate success, global_id 4585 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 10 monclient: _renew_subs 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x56539023f9f0 con 0x565390113c70 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 10 monclient: _renew_subs 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x56539019a680 con 0x565390113c70 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 1 librados: init done 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.116+0000 7fab8bf56780 10 librados: wait_for_osdmap waiting 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.202+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab740021f0 con 0x565390113c70 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.202+0000 7fab82ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.202+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fab740025c0 con 0x565390113c70 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.202+0000 7fab82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.202+0000 7fab82ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:01:19.204 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.202+0000 7fab82ffd640 10 monclient: dump: 2024-04-15T15:01:19.205 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: epoch 1 2024-04-15T15:01:19.205 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:01:19.205 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:01:19.205 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:01:19.205 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: min_mon_release 19 (squid) 2024-04-15T15:01:19.205 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: election_strategy: 3 2024-04-15T15:01:19.205 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:01:19.205 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.202+0000 7fab88a57640 4 set_mon_vals no callback set 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.202+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fab74018af0 con 0x565390113c70 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.203+0000 7fab89a59640 10 monclient: get_auth_request con 0x7fab6c06d370 auth_method 0 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.203+0000 7fab82ffd640 10 client.4585.objecter ms_handle_connect 0x7fab6c06d370 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.206+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 4090+0+0 (unknown 527133373 0 0) 0x7fab74050e50 con 0x565390113c70 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.206+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_map(28..28 src has 1..28) 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.206+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map got epochs [28,28] > 0 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.206+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding full epoch 28 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.206+0000 7fab82ffd640 20 client.4585.objecter dump_active .. 0 homeless 2024-04-15T15:01:22.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.206+0000 7fab8bf56780 10 librados: wait_for_osdmap done waiting 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.206+0000 7fab8bf56780 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.206+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fab7c001850 con 0x565390113c70 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.537+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fab7404ed60 con 0x565390113c70 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.537+0000 7fab82ffd640 10 monclient: handle_get_version_reply finishing 1 version 28 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.537+0000 7fab837fe640 10 client.4585.objecter _get_latest_version latest 28, have it 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.537+0000 7fab8bf56780 10 client.4585.objecter create_pool name=ceph_test_rados_api_asio 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.537+0000 7fab8bf56780 10 client.4585.objecter pool_op_submit 1 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.537+0000 7fab8bf56780 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:19.537+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x5653900926b0 con 0x565390113c70 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:21.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:21.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:21.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:22.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:21.782+0000 7fab81ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:01:22.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 10 ==== pool_op_reply(tid 1 (0) Success v30) ==== 43+0+0 (unknown 3084947863 0 0) 0x7fab74053250 con 0x565390113c70 2024-04-15T15:01:22.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 pool_op_reply(tid 1 (0) Success v30) 2024-04-15T15:01:22.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 10 client.4585.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v30) 2024-04-15T15:01:22.783 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 10 client.4585.objecter have request 1 at 0x56539023f730 Op: create 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 20 client.4585.objecter waiting for client to reach epoch 30 before calling back 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 10 monclient: _renew_subs 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=29}) -- 0x5653900dd640 con 0x565390113c70 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.003+0000 7fab82ffd640 10 client.4585.objecter done 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.053+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 11 ==== osd_map(29..30 src has 1..30) ==== 18545+0+0 (unknown 1472405917 0 0) 0x7fab74083570 con 0x565390113c70 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.053+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_map(29..30 src has 1..30) 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.053+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map got epochs [29,30] > 28 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.053+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 29 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 30 2024-04-15T15:01:22.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab82ffd640 20 client.4585.objecter dump_active .. 0 homeless 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 10 librados: set snap read head -> 1 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 10 librados: writefull oid=exist nspace= 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x5653900d9d70 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 30 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [writefull 0~5 in=5b] tid 2 osd.6 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 2 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 15 client.4585.objecter _send_op 2 to 16.1 on osd.6 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:2 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565390257090 con 0x565390253580 2024-04-15T15:01:22.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:01:22.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.054+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:01:22.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.111+0000 7fab8a25a640 10 monclient: get_auth_request con 0x565390253580 auth_method 0 2024-04-15T15:01:22.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.118+0000 7fab82ffd640 10 client.4585.objecter ms_handle_connect 0x565390253580 2024-04-15T15:01:27.848 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:03:05.691 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:27.853 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:03:05.696 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:27.924 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:03:05.767 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:27.932 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:03:05.776 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:27.986 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:03:05.776 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:28.008 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:03:05.851 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:28.021 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:03:05.812 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:28.057 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:03:05.900 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:28.130 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:03:05.920 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:01:33.784 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:22.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:23.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:23.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:23.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:24.117+0000 7fab8bcbd640 10 client.4585.objecter tick 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:24.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:24.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:24.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:25.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:25.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:25.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:26.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:26.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:26.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:27.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:27.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:27.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:28.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:28.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:28.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:29.117+0000 7fab8bcbd640 10 client.4585.objecter tick 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:29.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:29.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:29.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:30.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:30.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:30.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:31.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:31.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:31.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:31.782+0000 7fab81ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:32.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:32.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:32.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:33.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:33.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:33.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:33.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:33.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.118+0000 7fab8bcbd640 10 client.4585.objecter tick 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.118+0000 7fab8bcbd640 2 client.4585.objecter tid 2 on osd.6 is laggy 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.118+0000 7fab8bcbd640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.118+0000 7fab8bcbd640 10 monclient: _renew_subs 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.118+0000 7fab8bcbd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.118+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=31}) -- 0x7fab5c002f90 con 0x565390113c70 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.118+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- ping magic: 0 -- 0x7fab5c003370 con 0x565390253580 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 12 ==== osd_map(31..37 src has 1..37) ==== 15583+0+0 (unknown 3170404760 0 0) 0x7fab74052b10 con 0x565390113c70 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_map(31..37 src has 1..37) 2024-04-15T15:01:34.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map got epochs [31,37] > 30 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 31 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 31 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 32 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 32 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 33 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 33 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:34.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 34 2024-04-15T15:01:34.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:34.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 34 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:34.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:34.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 35 2024-04-15T15:01:34.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:39.121 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 35 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:39.121 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:39.121 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 36 2024-04-15T15:01:39.121 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:39.121 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 36 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 37 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 37 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter dump_active .. 0 homeless 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.122+0000 7fab82ffd640 20 client.4585.objecter 2 16.d3a59201 osd.6 exist [writefull 0~5 in=5b] 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:34.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:35.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:35.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:39.122 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:35.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:36.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:36.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:36.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:37.782+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:37.782+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:37.782+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:38.783+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:38.783+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:38.783+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.119+0000 7fab8bcbd640 10 client.4585.objecter tick 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.119+0000 7fab8bcbd640 2 client.4585.objecter tid 2 on osd.6 is laggy 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.119+0000 7fab8bcbd640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.119+0000 7fab8bcbd640 10 monclient: _renew_subs 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.119+0000 7fab8bcbd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:39.123 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.119+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=38}) -- 0x7fab5c003580 con 0x565390113c70 2024-04-15T15:01:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.119+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- ping magic: 0 -- 0x7fab5c003810 con 0x565390253580 2024-04-15T15:01:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.210+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 13 ==== osd_map(38..41 src has 1..41) ==== 4245+0+0 (unknown 2222175393 0 0) 0x7fab7404f090 con 0x565390113c70 2024-04-15T15:01:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.210+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_map(38..41 src has 1..41) 2024-04-15T15:01:41.785 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.210+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map got epochs [38,41] > 37 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.210+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 38 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.210+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.210+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 38 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.210+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.210+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 39 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 39 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 40 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 40 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:41.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 41 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 41 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 20 client.4585.objecter dump_active .. 0 homeless 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.211+0000 7fab82ffd640 20 client.4585.objecter 2 16.d3a59201 osd.6 exist [writefull 0~5 in=5b] 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.783+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.783+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:39.783+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:40.784+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:40.784+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:40.784+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:41.784+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:41.784+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:41.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:41.784+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:44.156 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:41.784+0000 7fab81ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:01:44.156 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:42.784+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:44.156 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:42.784+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:44.156 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:42.784+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:44.156 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:43.784+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:44.156 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:43.784+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:44.156 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:43.784+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.120+0000 7fab8bcbd640 10 client.4585.objecter tick 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.120+0000 7fab8bcbd640 2 client.4585.objecter tid 2 on osd.6 is laggy 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.120+0000 7fab8bcbd640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.120+0000 7fab8bcbd640 10 monclient: _renew_subs 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.120+0000 7fab8bcbd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.120+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=42}) -- 0x7fab5c003580 con 0x565390113c70 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.120+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- ping magic: 0 -- 0x7fab5c003ae0 con 0x565390253580 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 14 ==== osd_map(42..44 src has 1..44) ==== 2291+0+0 (unknown 314142362 0 0) 0x7fab74052db0 con 0x565390113c70 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_map(42..44 src has 1..44) 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map got epochs [42,44] > 41 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 42 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 42 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:44.157 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:44.158 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 43 2024-04-15T15:01:44.158 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:44.158 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 43 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:44.158 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:44.158 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 44 2024-04-15T15:01:44.158 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:44.158 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 44 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:44.158 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:44.158 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 20 client.4585.objecter dump_active .. 0 homeless 2024-04-15T15:01:48.818 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.154+0000 7fab82ffd640 20 cl api_service: [==========] Running 4 tests from 1 test suite. 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [----------] Global test environment set-up. 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [----------] 4 tests from LibRadosService 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5614 ms) 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [ OK ] LibRadosService.RegisterLate (43 ms) 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: cluster: 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: id: faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: health: HEALTH_WARN 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 21 pool(s) do not have an application enabled 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: services: 2024-04-15T15:01:48.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: osd: 8 osds: 8 up (since 100s), 8 in (since 2m) 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: data: 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: pools: 40 pools, 1153 pgs 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: objects: 2 objects, 449 KiB 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: pgs: 74.241% pgs unknown 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 24.718% pgs not active 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 856 unknown 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 209 creating+peering 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 76 creating+activating 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 12 active+clean 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 2024-04-15T15:01:48.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: cluster: 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: id: faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: health: HEALTH_WARN 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 18 pool(s) do not have an application enabled 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: services: 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: osd: 8 osds: 8 up (since 102s), 8 in (since 2m) 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: data: 2024-04-15T15:01:48.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: pools: 39 pools, 1145 pgs 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: objects: 2 objects, 449 KiB 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: pgs: 58.341% pgs unknown 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 40.349% pgs not active 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 668 unknown 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 361 creating+peering 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 101 creating+activating 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 15 active+clean 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [ OK ] LibRadosService.StatusFormat (4504 ms) 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [ RUN ] LibRadosService.Status 2024-04-15T15:01:48.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [ OK ] LibRadosService.Status (20046 ms) 2024-04-15T15:01:48.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [----------] 4 tests from LibRadosService (30207 ms total) 2024-04-15T15:01:48.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: 2024-04-15T15:01:48.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [----------] Global test environment tear-down 2024-04-15T15:01:48.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [==========] 4 tests from 1 test suite ran. (30208 ms total) 2024-04-15T15:01:48.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_service: [ PASSED ] 4 tests. 2024-04-15T15:01:49.124 INFO:tasks.workunit.client.0.smithi038.stdout:ient.4585.objecter 2 16.d3a59201 osd.6 exist [writefull 0~5 in=5b] 2024-04-15T15:01:49.124 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.784+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.784+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:44.784+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:45.784+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:45.784+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:45.784+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:46.784+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:46.784+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:46.784+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:47.784+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:47.784+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:49.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:47.784+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:48.784+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:48.784+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:48.784+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.121+0000 7fab8bcbd640 10 client.4585.objecter tick 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.121+0000 7fab8bcbd640 2 client.4585.objecter tid 2 on osd.6 is laggy 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.121+0000 7fab8bcbd640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.121+0000 7fab8bcbd640 10 monclient: _renew_subs 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.121+0000 7fab8bcbd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.121+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=45}) -- 0x7fab5c003580 con 0x565390113c70 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.121+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- ping magic: 0 -- 0x7fab5c003e00 con 0x565390253580 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 15 ==== osd_map(45..46 src has 1..46) ==== 947+0+0 (unknown 2241921791 0 0) 0x7fab740534e0 con 0x565390113c70 2024-04-15T15:01:49.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_map(45..46 src has 1..46) 2024-04-15T15:01:49.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map got epochs [45,46] > 44 2024-04-15T15:01:49.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 45 2024-04-15T15:01:49.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:49.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 45 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:49.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:49.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 46 2024-04-15T15:01:49.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:52.602 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:01:52.529+0000 ea52640 -1 osd.6 47 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4585.0:2 16.1 16.d3a59201 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:52.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:01:52.430+0000 ea52640 -1 osd.1 47 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4630.0:2 28.6 28.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [----------] Global test environment set-up. 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5784 ms) 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (694 ms) 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20716 ms) 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-04-15T15:01:52.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: attempt 0 of 20 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: failed to deregister: 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: { 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "epoch": 14, 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "modified": "2024-04-15T15:01:46.746171+0000", 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "services": { 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "laundry": { 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "daemons": { 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "summary": "", 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "close-test-pid41399": { 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "start_epoch": 14, 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "start_stamp": "2024-04-15T15:01:46.212811+0000", 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "gid": 54821, 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "addr": "172.21.15.38:0/236002877", 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "metadata": { 2024-04-15T15:01:52.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "arch": "x86_64", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "ceph_release": "squid", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-3080-gc2d8c315 (c2d8c3155d854ee204cb7c7261232571229d1d54) squid (dev)", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "ceph_version_short": "19.0.0-3080-gc2d8c315", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "distro": "centos", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "distro_version": "9", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "foo": "bar", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "hostname": "smithi038", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Apr 12 13:55:21 UTC 2024", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "kernel_version": "5.14.0-438.el9.x86_64", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "mem_swap_kb": "0", 2024-04-15T15:01:52.870 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "mem_total_kb": "32494648", 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "os": "Linux", 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "this": "that" 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: }, 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "task_status": {} 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: }, 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "pid41352": { 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "start_epoch": 13, 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "start_stamp": "2024-04-15T15:01:28.832571+0000", 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "gid": 54761, 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "addr": "172.21.15.38:0/1458111814", 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "metadata": { 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "arch": "x86_64", 2024-04-15T15:01:52.871 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "ceph_release": "squid", 2024-04-15T15:01:52.872 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-3080-gc2d8c315 (c2d8c3155d854ee204cb7c7261232571229d1d54) squid (dev)", 2024-04-15T15:01:52.872 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "ceph_version_short": "19.0.0-3080-gc2d8c315", 2024-04-15T15:01:52.872 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-04-15T15:01:52.966 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:01:52.944+0000 12a5a640 -1 osd.3 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4645.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:53.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:01:53.488+0000 ea52640 -1 osd.1 47 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4630.0:2 28.6 28.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:53.995 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:01:53.872+0000 ea52640 -1 osd.6 48 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4585.0:2 16.1 16.d3a59201 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:54.030 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:01:53.989+0000 12a5a640 -1 osd.2 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54395.0:2 18.6 18.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:01:54.058 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:01:54.000+0000 12a5a640 -1 osd.3 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4645.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:54.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:01:54.546+0000 ea52640 -1 osd.1 47 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4630.0:2 28.6 28.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:54.613 INFO:tasks.workunit.client.0.smithi038.stdout: 46 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:54.613 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:54.613 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 20 client.4585.objecter dump_active .. 0 homeless 2024-04-15T15:01:54.613 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.123+0000 7fab82ffd640 20 client.4585.objecter 2 16.d3a59201 osd.6 exist [writefull 0~5 in=5b] 2024-04-15T15:01:54.613 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.785+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:54.613 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.785+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:49.785+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:50.785+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:50.785+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:50.785+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:51.785+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:51.785+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:51.785+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:51.785+0000 7fab81ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:52.785+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:52.785+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:52.785+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:53.785+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:54.614 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:53.785+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:53.785+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.122+0000 7fab8bcbd640 10 client.4585.objecter tick 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.122+0000 7fab8bcbd640 2 client.4585.objecter tid 2 on osd.6 is laggy 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.122+0000 7fab8bcbd640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.122+0000 7fab8bcbd640 10 monclient: _renew_subs 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.122+0000 7fab8bcbd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.122+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=47}) -- 0x7fab5c003580 con 0x565390113c70 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.122+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- ping magic: 0 -- 0x7fab5c0040d0 con 0x565390253580 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 16 ==== osd_map(47..48 src has 1..48) ==== 1671+0+0 (unknown 1123277472 0 0) 0x7fab74051760 con 0x565390113c70 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_map(47..48 src has 1..48) 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map got epochs [47,48] > 46 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 47 2024-04-15T15:01:54.615 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:54.629 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 47 base exist @16 precalc_pgid 0 pg handler_error: Running main() from gmock_main.cc 2024-04-15T15:01:54.629 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-04-15T15:01:54.629 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: [----------] Global test environment set-up. 2024-04-15T15:01:54.630 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-04-15T15:01:54.630 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-04-15T15:01:54.630 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (35859 ms) 2024-04-15T15:01:54.630 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: [----------] 1 test from neocls_handler_error (35859 ms total) 2024-04-15T15:01:54.630 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: 2024-04-15T15:01:54.630 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: [----------] Global test environment tear-down 2024-04-15T15:01:54.630 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: [==========] 1 test from 1 test suite ran. (35859 ms total) 2024-04-15T15:01:54.630 INFO:tasks.workunit.client.0.smithi038.stdout: handler_error: [ PASSED ] 1 test. 2024-04-15T15:01:55.020 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:01:55.014+0000 12a5a640 -1 osd.3 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4645.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:55.063 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:01:55.015+0000 ea52640 -1 osd.6 48 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4585.0:2 16.1 16.d3a59201 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:55.070 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:01:55.064+0000 12a5a640 -1 osd.2 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54395.0:2 18.6 18.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:01:55.298 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:01:55.176+0000 12a5a640 -1 osd.5 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4647.0:2 25.6 25.c53660c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:01:55.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:01:55.619+0000 ea52640 -1 osd.1 47 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4630.0:2 28.6 28.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:56.066 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:01:56.057+0000 ea52640 -1 osd.6 48 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4585.0:2 16.1 16.d3a59201 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:56.118 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:01:56.040+0000 12a5a640 -1 osd.3 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4645.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:56.511 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:01:56.500+0000 12a5a640 -1 osd.5 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4647.0:2 25.6 25.c53660c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:01:56.933 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:01:56.913+0000 12a5a640 -1 osd.2 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54395.0:2 18.6 18:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:01:57.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:01:57.036+0000 ea52640 -1 osd.1 48 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4630.0:2 28.6 28.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:57.164 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:01:57.045+0000 12a5a640 -1 osd.3 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4645.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:57.251 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:01:57.058+0000 ea52640 -1 osd.6 49 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4585.0:2 16.1 16.d3a59201 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:57.900 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:01:57.891+0000 12a5a640 -1 osd.5 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4647.0:2 25.6 25.c53660c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:01:58.154 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:01:58.136+0000 12a5a640 -1 osd.2 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54395.0:2 18.6 18:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:01:58.166 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:01:58.142+0000 ea52640 -1 osd.6 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4585.0:2 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:58.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:01:58.129+0000 ea52640 -1 osd.1 48 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4630.0:2 28.6 28.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:58.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:01:58.511+0000 12a5a640 -1 osd.3 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4645.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:58.966 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:01:58.957+0000 12a5a640 -1 osd.5 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4647.0:2 25.6 25.c53660c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:01:59.124 INFO:tasks.workunit.client.0.smithi038.stdout:id 0.0 is_write 2024-04-15T15:01:59.124 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:59.124 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 48 2024-04-15T15:01:59.124 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:59.124 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 48 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:59.124 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:59.124 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 20 client.4585.objecter dump_active .. 0 homeless 2024-04-15T15:01:59.124 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.612+0000 7fab82ffd640 20 client.4585.objecter 2 16.d3a59201 osd.6 exist [writefull 0~5 in=5b] 2024-04-15T15:01:59.124 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.785+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.785+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:54.785+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:55.785+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:55.785+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:55.785+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:56.785+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:56.785+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:56.785+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:57.785+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:57.785+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:57.785+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:58.786+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:58.786+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:01:59.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:58.786+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.066+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 1 ==== osd_map(31..49 src has 1..49) ==== 25601+0+0 (unknown 587502653 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.066+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_map(31..49 src has 1..49) 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.066+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map got epochs [31,49] > 48 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.066+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 49 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.066+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.066+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 49 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.066+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.066+0000 7fab82ffd640 20 client.4585.objecter dump_active .. 0 homeless 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.066+0000 7fab82ffd640 20 client.4585.objecter 2 16.d3a59201 osd.6 exist [writefull 0~5 in=5b] 2024-04-15T15:01:59.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.123+0000 7fab8bcbd640 10 client.4585.objecter tick 2024-04-15T15:01:59.160 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:01:59.152+0000 ea52640 -1 osd.6 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4585.0:2 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:59.524 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.123+0000 7fab8bcbd640 api_service_pp: "distro": "centos", 2024-04-15T15:01:59.524 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-04-15T15:01:59.524 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "distro_version": "9", 2024-04-15T15:01:59.525 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "foo": "bar", 2024-04-15T15:01:59.525 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "hostname": "smithi038", 2024-04-15T15:01:59.525 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Fri Apr 12 13:55:21 UTC 2024", 2024-04-15T15:01:59.525 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "kernel_version": "5.14.0-438.el9.x86_64", 2024-04-15T15:01:59.525 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "mem_swap_kb": "0", 2024-04-15T15:01:59.525 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "mem_total_kb": "32494648", 2024-04-15T15:01:59.525 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "os": "Linux", 2024-04-15T15:01:59.525 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "this": "that" 2024-04-15T15:01:59.525 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: }, 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: "task_status": {} 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: } 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: } 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: } 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: } 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: } 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: attempt 1 of 20 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (13707 ms) 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (40901 ms total) 2024-04-15T15:01:59.526 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: 2024-04-15T15:01:59.527 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [----------] Global test environment tear-down 2024-04-15T15:01:59.527 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (40901 ms total) 2024-04-15T15:01:59.527 INFO:tasks.workunit.client.0.smithi038.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-04-15T15:01:59.570 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:01:59.414+0000 12a5a640 -1 osd.2 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54395.0:2 18.6 18:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:01:59.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:01:59.546+0000 ea52640 -1 osd.1 49 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4630.0:2 28.6 28:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:01:59.940 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:01:59.933+0000 12a5a640 -1 osd.5 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4647.0:2 25.6 25.c53660c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:02:00.221 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:02:00.211+0000 ea52640 -1 osd.6 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4585.0:2 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:00.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:02:00.627+0000 ea52640 -1 osd.1 49 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4630.0:2 28.6 28:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:01.316 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:02:01.304+0000 ea52640 -1 osd.6 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4585.0:2 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:01.940 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:02:01.878+0000 12a5a640 -1 osd.5 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4647.0:2 25.6 25.c53660c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:02:01.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:02:01.765+0000 ea52640 -1 osd.1 50 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4630.0:2 28.6 28:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:02.675 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:02:02.636+0000 ea52640 -1 osd.6 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4585.0:2 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:02.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:02:02.888+0000 ea52640 -1 osd.1 50 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4630.0:2 28.6 28:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:02.932 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:02:02.926+0000 12a5a640 -1 osd.5 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4647.0:2 25.6 25.c53660c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:02:03.622 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:02:03.609+0000 ea52640 -1 osd.6 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4585.0:2 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:04.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:02:03.976+0000 ea52640 -1 osd.1 50 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4630.0:2 28.6 28:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout:2 client.4585.objecter tid 2 on osd.6 is laggy 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.123+0000 7fab8bcbd640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.123+0000 7fab8bcbd640 10 monclient: _renew_subs 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.123+0000 7fab8bcbd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.123+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=50}) -- 0x7fab5c003580 con 0x565390113c70 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.123+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- ping magic: 0 -- 0x7fab5c004340 con 0x565390253580 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.786+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.786+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:01:59.786+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:02:04.125 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.129+0000 7fab82ffd640 1 -- 172.21.15.38:0/443484706 <== mon.1 v1:172.21.15.164:6789/0 17 ==== osd_map(50..50 src has 1..50) ==== 692+0+0 (unknown 1249134547 0 0) 0x7fab740583b0 con 0x565390113c70 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.129+0000 7fab82ffd640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_map(50..50 src has 1..50) 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.129+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map got epochs [50,50] > 49 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.129+0000 7fab82ffd640 3 client.4585.objecter handle_osd_map decoding incremental epoch 50 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.129+0000 7fab82ffd640 10 client.4585.objecter checking op 2 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.129+0000 7fab82ffd640 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.129+0000 7fab82ffd640 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.129+0000 7fab82ffd640 20 client.4585.objecter dump_active .. 0 homeless 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.129+0000 7fab82ffd640 20 client.4585.objecter 2 16.d3a59201 osd.6 exist [writefull 0~5 in=5b] 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.786+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.786+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:00.786+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:01.786+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:02:04.126 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:01.786+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:02:04.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:01.786+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:02:04.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:01.786+0000 7fab81ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:02:04.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:02.786+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:02:04.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:02.786+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:02:04.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:02.786+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:02:04.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:03.786+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:02:04.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:03.786+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:02:04.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:03.786+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:02:04.127 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.124+0000 7fab8bcbd640 10 client.4585.objecter tick 2024-04-15T15:02:04.609 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:02:04.582+0000 ea52640 -1 osd.6 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4585.0:2 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:04.627 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:03:42.470 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:04.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.124+0000 7fab8bcbd640 2 client.4585.objecter tid 2 on osd.6 is laggy 2024-04-15T15:02:04.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.124+0000 7fab8bcbd640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:02:04.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.124+0000 7fab8bcbd640 10 monclient: _renew_subs 2024-04-15T15:02:04.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.124+0000 7fab8bcbd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:02:04.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.124+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=51}) -- 0x7fab5c003580 con 0x565390113c70 2024-04-15T15:02:04.786 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.124+0000 7fab8bcbd640 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- ping magic: 0 -- 0x7fab5c004520 con 0x565390253580 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 2 ==== osd_op_reply(2 exist [writefull 0~5] v49'1 uv1 ondisk = 0) ==== 149+0+0 (unknown 805641837 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(2 exist [writefull 0~5] v49'1 uv1 ondisk = 0) 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 2 ondisk uv 1 in 16.1 attempt 0 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 2 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 15 client.4585.objecter _finish_op 2 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 2 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 10 librados: Objecter returned from writefull r=0 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-04-15T15:02:04.787 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x5653900d9d70 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [read 0~256] tid 3 osd.6 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 3 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 15 client.4585.objecter _send_op 3 to 16.1 on osd.6 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:3 16.1 16:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x565390252060 con 0x565390253580 2024-04-15T15:02:04.788 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.812 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:04.812 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390252440 2024-04-15T15:02:04.812 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base noexist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:04.812 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter _calc_target target noexist @16 -> pgid 16.a7bbaa1 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.a7bbaa1 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid noexist '@16' '@16' [read 0~256] tid 4 osd.6 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 4 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 15 client.4585.objecter _send_op 4 to 16.1 on osd.6 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:4 16.1 16:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5653902528f0 con 0x565390253580 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.785+0000 7fab8bf56780 5 client.4585.objecter 2 in flight 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.786+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.786+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.786+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 1380702997 0 3741568377) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:04.813 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 3 ondisk uv 1 in 16.1 attempt 0 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 5 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 3 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 15 client.4585.objecter _finish_op 3 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 3 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.808+0000 7fab8a25a640 5 client.4585.objecter 1 in flight 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 4 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3314560972 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:04.814 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 4 ondisk uv 0 in 16.1 attempt 0 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 10 client.4585.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 4 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 15 client.4585.objecter _finish_op 4 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 4 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (27 ms) 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390252440 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [read 0~256] tid 5 osd.6 2024-04-15T15:02:04.815 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 5 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 15 client.4585.objecter _send_op 5 to 16.1 on osd.6 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:5 16.1 16:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5653900d9d70 con 0x565390253580 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390257430 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base noexist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter _calc_target target noexist @16 -> pgid 16.a7bbaa1 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.a7bbaa1 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.816 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid noexist '@16' '@16' [read 0~256] tid 6 osd.6 2024-04-15T15:02:04.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 6 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 15 client.4585.objecter _send_op 6 to 16.1 on osd.6 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:6 16.1 16:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5653902578e0 con 0x565390253580 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.811+0000 7fab8bf56780 5 client.4585.objecter 2 in flight 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 1380702997 0 3741568377) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 5 ondisk uv 1 in 16.1 attempt 0 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 5 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 5 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 15 client.4585.objecter _finish_op 5 2024-04-15T15:02:04.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 5 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 5 client.4585.objecter 1 in flight 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 6 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3314560972 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 6 ondisk uv 0 in 16.1 attempt 0 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 10 client.4585.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 6 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 15 client.4585.objecter _finish_op 6 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 6 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:04.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (10 ms) 2024-04-15T15:02:04.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-04-15T15:02:04.832 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390257430 2024-04-15T15:02:04.832 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:04.832 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [read 0~256] tid 7 osd.6 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 7 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 15 client.4585.objecter _send_op 7 to 16.1 on osd.6 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:7 16.1 16:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x565390252440 con 0x565390253580 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390298310 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base noexist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter _calc_target target noexist @16 -> pgid 16.a7bbaa1 2024-04-15T15:02:04.833 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.a7bbaa1 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid noexist '@16' '@16' [read 0~256] tid 8 osd.6 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 8 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 15 client.4585.objecter _send_op 8 to 16.1 on osd.6 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:8 16.1 16:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5653902987c0 con 0x565390253580 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.821+0000 7fab8bf56780 5 client.4585.objecter 2 in flight 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 1380702997 0 3741568377) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:04.834 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 7 ondisk uv 1 in 16.1 attempt 0 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 5 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 7 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 15 client.4585.objecter _finish_op 7 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 7 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 5 client.4585.objecter 1 in flight 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 8 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3314560972 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 8 ondisk uv 0 in 16.1 attempt 0 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 10 client.4585.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 8 2024-04-15T15:02:04.835 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 15 client.4585.objecter _finish_op 8 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (10 ms) 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 8 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 20 librados: queue_aio_write 0x5653900552c0 completion 0x565390028810 write_seq 1 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390257430 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:04.836 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [write 0~5 in=5b] tid 9 osd.6 2024-04-15T15:02:04.837 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:04.837 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 9 2024-04-15T15:02:04.935 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:02:04.927+0000 12a5a640 -1 osd.5 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4647.0:2 25.6 25:63066ca3:test-rados-api-smithi038-41424-3::testobj:head [write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) 2024-04-15T15:02:04.963 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 15 api_misc: [==========] Running 12 tests from 4 test suites. 2024-04-15T15:02:04.963 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] Global test environment set-up. 2024-04-15T15:02:04.963 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: 2024-04-15T15:01:18.898+0000 7f0f780f9780 -1 failed for service _ceph-mon._tcp 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: 2024-04-15T15:01:18.898+0000 7f0f780f9780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (428 ms) 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2005 ms) 2024-04-15T15:02:04.964 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2433 ms total) 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e49468e810 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e49468a660 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a253d0 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a25e20 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a267e0 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a27270 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a27ce0 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a28730 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a29210 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4948ef5b0 2024-04-15T15:02:04.965 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a0d530 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2a680 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a28e00 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2b190 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2bc90 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2a490 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2cc80 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2b980 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2d850 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2dff0 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2e740 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2ee90 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2f960 2024-04-15T15:02:04.966 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2c870 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2ca70 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a30e80 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a2f730 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b0b70 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e494a30ad0 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b1680 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b2160 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b0900 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b30e0 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b1e10 2024-04-15T15:02:04.967 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b3c30 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b4380 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b4a70 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b54e0 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b2e60 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 0x55e4952b6080 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: started 40 aios 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e49468e810 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e49468a660 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a253d0 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a25e20 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a267e0 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a27270 2024-04-15T15:02:04.968 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a27ce0 2024-04-15T15:02:04.969 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a28730 2024-04-15T15:02:04.969 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a29210 2024-04-15T15:02:04.969 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4948ef5b0 2024-04-15T15:02:04.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:02:04.961+0000 ea52640 -1 osd.1 50 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4630.0:2 28.6 28:602f83fe:::foo:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-04-15T15:02:04.979 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:03:42.822 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:05.370 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:03:43.213 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:05.500 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:03:43.343 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:05.733 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:03:43.576 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:05.887 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:03:43.730 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:06.549 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55 client.4585.objecter _send_op 9 to 16.1 on osd.6 2024-04-15T15:02:06.549 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:9 16.1 16:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x565390258c90 con 0x565390253580 2024-04-15T15:02:06.549 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.549 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.549 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:04.831+0000 7fab8bf56780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-04-15T15:02:06.549 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:05.786+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:02:06.549 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:05.786+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:02:06.549 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:05.786+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 9 ==== osd_op_reply(9 exist [write 0~5] v50'2 uv2 ondisk = 0) ==== 149+0+0 (unknown 2078544838 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(9 exist [write 0~5] v50'2 uv2 ondisk = 0) 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 9 ondisk uv 2 in 16.1 attempt 0 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 9 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 15 client.4585.objecter _finish_op 9 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 9 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8a25a640 20 librados: complete_aio_write 0x565390028810 2024-04-15T15:02:06.550 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (1716 ms) 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 20 librados: queue_aio_write 0x5653900552c0 completion 0x565390017b40 write_seq 2 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390257430 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [write 0~5 in=5b] tid 10 osd.6 2024-04-15T15:02:06.551 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.642 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 10 2024-04-15T15:02:06.642 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 15 client.4585.objecter _send_op 10 to 16.1 on osd.6 2024-04-15T15:02:06.642 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:10 16.1 16:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x565390258c90 con 0x565390253580 2024-04-15T15:02:06.642 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.642 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.642 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.548+0000 7fab8bf56780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-04-15T15:02:06.642 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 10 ==== osd_op_reply(10 exist [write 0~5] v50'3 uv3 ondisk = 0) ==== 149+0+0 (unknown 258254866 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.642 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(10 exist [write 0~5] v50'3 uv3 ondisk = 0) 2024-04-15T15:02:06.642 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 10 ondisk uv 3 in 16.1 attempt 0 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 10 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 15 client.4585.objecter _finish_op 10 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 10 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8a25a640 20 librados: complete_aio_write 0x565390017b40 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (91 ms) 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 20 librados: queue_aio_write 0x5653900552c0 completion 0x565390257430 write_seq 3 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x56539027b470 2024-04-15T15:02:06.643 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:02:06.644 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:06.644 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.644 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.644 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [write 0~5 in=5b] tid 11 osd.6 2024-04-15T15:02:06.644 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.644 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 11 2024-04-15T15:02:06.644 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 15 client.4585.objecter _send_op 11 to 16.1 on osd.6 2024-04-15T15:02:06.696 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.638+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:11 16.1 16:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x56539027b920 con 0x565390253580 2024-04-15T15:02:06.696 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.639+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.696 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.639+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.696 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.639+0000 7fab8bf56780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-04-15T15:02:06.696 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 11 ==== osd_op_reply(11 exist [write 0~5] v50'4 uv4 ondisk = 0) ==== 149+0+0 (unknown 1158413775 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.696 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(11 exist [write 0~5] v50'4 uv4 ondisk = 0) 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 11 ondisk uv 4 in 16.1 attempt 0 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 11 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 15 client.4585.objecter _finish_op 11 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 11 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8a25a640 20 librados: complete_aio_write 0x565390257430 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (57 ms) 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390257c80 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:06.697 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:06.698 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.698 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.698 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [read 0~0] tid 12 osd.6 2024-04-15T15:02:06.698 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.698 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 12 2024-04-15T15:02:06.698 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 15 client.4585.objecter _send_op 12 to 16.1 on osd.6 2024-04-15T15:02:06.698 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:12 16.1 16:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x565390258130 con 0x565390253580 2024-04-15T15:02:06.698 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.698 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x5653902584d0 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base noexist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter _calc_target target noexist @16 -> pgid 16.a7bbaa1 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.a7bbaa1 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid noexist '@16' '@16' [read 0~0] tid 13 osd.6 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 13 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 15 client.4585.objecter _send_op 13 to 16.1 on osd.6 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:13 16.1 16:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x56539027bda0 con 0x565390253580 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:06.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.695+0000 7fab8bf56780 5 client.4585.objecter 2 in flight 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) ==== 149+0+5 (unknown 538524132 0 3741568377) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 12 ondisk uv 4 in 16.1 attempt 0 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 5 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 12 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 15 client.4585.objecter _finish_op 12 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 12 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 13 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2820149748 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 13 ondisk uv 0 in 16.1 attempt 0 2024-04-15T15:02:06.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 10 client.4585.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 13 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 15 client.4585.objecter _finish_op 13 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 13 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (30 ms) 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390257c80 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [read 0~0] tid 14 osd.6 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 14 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 15 client.4585.objecter _send_op 14 to 16.1 on osd.6 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:14 16.1 16:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x565390258130 con 0x565390253580 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390258730 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base noexist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter _calc_target target noexist @16 -> pgid 16.a7bbaa1 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.a7bbaa1 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.730 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid noexist '@16' '@16' [read 0~0] tid 15 osd.6 2024-04-15T15:02:06.731 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.731 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 15 2024-04-15T15:02:06.731 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 15 client.4585.objecter _send_op 15 to 16.1 on osd.6 2024-04-15T15:02:06.766 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:15 16.1 16:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x56539027c180 con 0x565390253580 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.725+0000 7fab8bf56780 5 client.4585.objecter 2 in flight 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) ==== 149+0+5 (unknown 538524132 0 3741568377) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 14 ondisk uv 4 in 16.1 attempt 0 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 5 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 14 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 15 client.4585.objecter _finish_op 14 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 14 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.767 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 15 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2820149748 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 15 ondisk uv 0 in 16.1 attempt 0 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 10 client.4585.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 15 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 15 client.4585.objecter _finish_op 15 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 15 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (40 ms) 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390258730 2024-04-15T15:02:06.768 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:06.769 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:06.818 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.818 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.818 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [read 0~0] tid 16 osd.6 2024-04-15T15:02:06.818 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.818 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 16 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 15 client.4585.objecter _send_op 16 to 16.1 on osd.6 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:16 16.1 16:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x56539027c180 con 0x565390253580 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x56539027ae00 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base noexist @16 precalc_pgid 0 pgid 0.0 is_read 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter _calc_target target noexist @16 -> pgid 16.a7bbaa1 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.a7bbaa1 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid noexist '@16' '@16' [read 0~0] tid 17 osd.6 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 17 2024-04-15T15:02:06.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 15 client.4585.objecter _send_op 17 to 16.1 on osd.6 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:17 16.1 16:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x56539027b2b0 con 0x565390253580 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.765+0000 7fab8bf56780 5 client.4585.objecter 2 in flight 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.786+0000 7fab81ffb640 10 monclient: tick 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.786+0000 7fab81ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.786+0000 7fab81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) ==== 149+0+5 (unknown 538524132 0 3741568377) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 16 ondisk uv 4 in 16.1 attempt 0 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 5 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 16 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 15 client.4585.objecter _finish_op 16 2024-04-15T15:02:06.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 5 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 16 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 17 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2820149748 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 17 ondisk uv 0 in 16.1 attempt 0 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 10 client.4585.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 17 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 15 client.4585.objecter _finish_op 17 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 17 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (52 ms) 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 20 librados: queue_aio_write 0x5653900552c0 completion 0x565390258620 write_seq 4 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390258730 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [writefull 0~5 in=5b] tid 18 osd.6 2024-04-15T15:02:06.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 18 2024-04-15T15:02:06.823 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 15 client.4585.objecter _send_op 18 to 16.1 on osd.6 2024-04-15T15:02:06.855 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:18 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x56539027bfc0 con 0x565390253580 2024-04-15T15:02:06.855 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.855 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.817+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:06.855 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 18 ==== osd_op_reply(18 exist [writefull 0~5] v50'5 uv5 ondisk = 0) ==== 149+0+0 (unknown 2898063503 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(18 exist [writefull 0~5] v50'5 uv5 ondisk = 0) 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 18 ondisk uv 5 in 16.1 attempt 0 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 18 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 15 client.4585.objecter _finish_op 18 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 18 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8a25a640 20 librados: complete_aio_write 0x565390258620 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (37 ms) 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 20 librados: queue_aio_write 0x5653900552c0 completion 0x56539027bda0 write_seq 5 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390258730 2024-04-15T15:02:06.856 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:02:06.857 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:06.857 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:06.857 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.857 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [writefull 0~5 in=5b] tid 19 osd.6 2024-04-15T15:02:06.857 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:06.857 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 19 2024-04-15T15:02:06.857 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 15 client.4585.objecter _send_op 19 to 16.1 on osd.6 2024-04-15T15:02:06.857 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:19 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x56539027bfc0 con 0x565390253580 2024-04-15T15:02:06.857 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:06.926 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.854+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:07.004 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 19 ==== osd_op_reply(19 exist [writefull 0~5] v50'6 uv6 ondisk = 0) ==== 149+0+0 (unknown 826096883 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:07.004 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(19 exist [writefull 0~5] v50'6 uv6 ondisk = 0) 2024-04-15T15:02:07.004 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 19 ondisk uv 6 in 16.1 attempt 0 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 19 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 15 client.4585.objecter _finish_op 19 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 19 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8a25a640 20 librados: complete_aio_write 0x56539027bda0 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (31 ms) 2024-04-15T15:02:07.005 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-04-15T15:02:07.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 20 librados: queue_aio_write 0x5653900552c0 completion 0x56539027bda0 write_seq 6 2024-04-15T15:02:07.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 10 client.4585.objecter _op_submit op 0x565390258730 2024-04-15T15:02:07.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 20 client.4585.objecter _calc_target epoch 50 base exist @16 precalc_pgid 0 pgid 0.0 is_write 2024-04-15T15:02:07.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 20 client.4585.objecter _calc_target target exist @16 -> pgid 16.d3a59201 2024-04-15T15:02:07.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 10 client.4585.objecter _calc_target raw pgid 16.d3a59201 -> actual 16.1 acting [6,1] primary 6 2024-04-15T15:02:07.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 20 client.4585.objecter _get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:07.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 10 client.4585.objecter _op_submit oid exist '@16' '@16' [writefull 0~5 in=5b] tid 20 osd.6 2024-04-15T15:02:07.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 20 client.4585.objecter get_session s=0x5653900dd810 osd=6 3 2024-04-15T15:02:07.006 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 15 client.4585.objecter _session_op_assign 6 20 2024-04-15T15:02:07.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 15 client.4585.objecter _send_op 20 to 16.1 on osd.6 2024-04-15T15:02:07.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 --> v1:172.21.15.164:6808/3078148286 -- osd_op(unknown.0.0:20 16.1 16:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x56539027bfc0 con 0x565390253580 2024-04-15T15:02:07.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:07.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.886+0000 7fab8bf56780 5 client.4585.objecter 1 in flight 2024-04-15T15:02:07.007 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 <== osd.6 v1:172.21.15.164:6808/3078148286 20 ==== osd_op_reply(20 exist [writefull 0~5] v50'7 uv7 ondisk = 0) ==== 149+0+0 (unknown 1170048807 0 0) 0x7fab840029a0 con 0x565390253580 2024-04-15T15:02:07.008 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 10 client.4585.objecter ms_dispatch 0x565390083a70 osd_op_reply(20 exist [writefull 0~5] v50'7 uv7 ondisk = 0) 2024-04-15T15:02:07.008 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 10 client.4585.objecter in handle_osd_op_reply 2024-04-15T15:02:07.008 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 7 client.4585.objecter handle_osd_op_reply 20 ondisk uv 7 in 16.1 attempt 0 2024-04-15T15:02:07.008 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 10 client.4585.objecter op 0 rval 0 len 0 2024-04-15T15:02:07.008 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 15 client.4585.objecter handle_osd_op_reply completed tid 20 2024-04-15T15:02:07.008 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 15 client.4585.objecter _finish_op 20 2024-04-15T15:02:07.008 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 4 2024-04-15T15:02:07.008 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 15 client.4585.objecter _session_op_remove 6 20 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 5 client.4585.objecter 0 in flight 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8a25a640 20 librados: complete_aio_write 0x56539027bda0 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (39 ms) 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8bf56780 10 librados: watch_flush enter 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8bf56780 10 librados: watch_flush exit 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8bf56780 10 client.4585.objecter close_session for osd.6 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 >> v1:172.21.15.164:6808/3078148286 conn(0x565390253580 legacy=0x565390255970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8bf56780 20 client.4585.objecter put_session s=0x5653900dd810 osd=6 1 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8bf56780 20 client.4585.objecter shutdown clearing up homeless session... 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.924+0000 7fab8bf56780 10 client.4585.objecter successfully canceled tick 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 >> v1:172.21.15.38:6800/1608957829 conn(0x7fab6c06d370 legacy=0x7fab6c06f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8bf56780 10 monclient: shutdown 2024-04-15T15:02:07.009 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8bf56780 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:02:07.010 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 >> v1:172.21.15.164:6789/0 conn(0x565390113c70 legacy=0x565390241210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:02:07.010 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8a25a640 1 -- 172.21.15.38:0/443484706 reap_dead start 2024-04-15T15:02:07.010 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 shutdown_connections 2024-04-15T15:02:07.010 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 >> 172.21.15.38:0/443484706 conn(0x56539011c380 msgr2=0x5653901a45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:02:07.010 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 shutdown_connections 2024-04-15T15:02:07.010 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8bf56780 1 -- 172.21.15.38:0/443484706 wait complete. 2024-04-15T15:02:07.010 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:06.925+0000 7fab8bf56780 1 librados: shutdown 2024-04-15T15:02:07.010 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [----------] 12 tests from AsioRados (2140 ms total) 2024-04-15T15:02:07.010 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: 2024-04-15T15:02:07.011 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [----------] Global test environment tear-down 2024-04-15T15:02:07.011 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (48304 ms total) 2024-04-15T15:02:07.011 INFO:tasks.workunit.client.0.smithi038.stdout: api_asio: [ PASSED ] 12 tests. 2024-04-15T15:02:07.490 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:03:45.281 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:07.520 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:03:45.311 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:07.749 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:03:45.540 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:08.084 INFO:tasks.workunit.client.0.smithi038.stdout: pool: Running main() from gmock_main.cc 2024-04-15T15:02:08.084 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-04-15T15:02:08.084 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [----------] Global test environment set-up. 2024-04-15T15:02:08.084 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ OK ] NeoRadosPools.PoolList (4662 ms) 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (4206 ms) 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (7762 ms) 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (10371 ms) 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (7079 ms) 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (15157 ms) 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [----------] 6 tests from NeoRadosPools (49237 ms total) 2024-04-15T15:02:08.085 INFO:tasks.workunit.client.0.smithi038.stdout: pool: 2024-04-15T15:02:08.086 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [----------] Global test environment tear-down 2024-04-15T15:02:08.086 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [==========] 6 tests from 1 test suite ran. (49238 ms total) 2024-04-15T15:02:08.086 INFO:tasks.workunit.client.0.smithi038.stdout: pool: [ PASSED ] 6 tests. 2024-04-15T15:02:13.489 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-04-15T15:02:13.490 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-04-15T15:02:13.490 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-04-15T15:02:13.490 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-04-15T15:02:13.490 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (54827 ms) 2024-04-15T15:02:13.490 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (54828 ms total) 2024-04-15T15:02:13.490 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: 2024-04-15T15:02:13.490 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-04-15T15:02:13.490 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (54828 ms total) 2024-04-15T15:02:13.490 INFO:tasks.workunit.client.0.smithi038.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (877 ms) 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (624 ms) 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-04-15T15:02:13.493 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (53413 ms) 2024-04-15T15:02:13.494 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (54914 ms total) 2024-04-15T15:02:13.494 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: 2024-04-15T15:02:13.494 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-04-15T15:02:13.494 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (54914 ms total) 2024-04-15T15:02:13.494 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: Running main() from gmock_main.cc 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [----------] Global test environment set-up. 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (1434 ms) 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (1721 ms) 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (52464 ms) 2024-04-15T15:02:15.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:04.929791+0000 osd.5 [WRN] 1 slow requests (by type [ 'waiting for sub ops' : 1 ] most affected pool [ 'CReadOpsTest_smithi038-41424-1' : 1 ]) 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:13.239749+0000 mon.a [WRN] Health check update: 19 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:13.240415+0000 mon.a [INF] Health check cleared: SLOW_OPS (was: 6 slow ops, oldest one blocked for 36 sec, daemons [osd.1,osd.2,osd.3,osd.5,osd.6] have slow ops.) 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:13.267962+0000 mon.c [INF] from='client.? v1:172.21.15.38:0/1260394898' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi038-41938-1"}]: dispatch 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:13.367439+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/3716454778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi038-41801-2"}]: dispatch 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:13.451933+0000 mon.a [INF] from='client.54530 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi038-41938-1"}]: dispatch 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:13.488715+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/172856345' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi038-41473-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:13.957285+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/3716454778' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi038-41801-2"}]': finished 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:13.958622+0000 mon.a [INF] from='client.54530 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi038-41938-1"}]': finished 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:13.960281+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/172856345' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi038-41473-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.136883+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/3716454778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi038-41801-2"}]: dispatch 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.173093+0000 mon.b [INF] from='client.? v1:172.21.15.38:0/3925825287' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi038-41222-1"}]: dispatch 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.187344+0000 mon.c [INF] from='client.? v1:172.21.15.38:0/1260394898' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi038-41938-1"}]: dispatch 2024-04-15T15:02:15.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.336685+0000 mon.a [INF] from='client.4558 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi038-41222-1"}]: dispatch 2024-04-15T15:02:15.584 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:1 ec_io: Running main() from gmock_main.cc 2024-04-15T15:02:15.584 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-04-15T15:02:15.584 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [----------] Global test environment set-up. 2024-04-15T15:02:15.584 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-04-15T15:02:15.585 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-04-15T15:02:15.585 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (10849 ms) 2024-04-15T15:02:15.585 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-04-15T15:02:15.585 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (45950 ms) 2024-04-15T15:02:15.585 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (56799 ms total) 2024-04-15T15:02:15.585 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: 2024-04-15T15:02:15.585 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [----------] Global test environment tear-down 2024-04-15T15:02:15.585 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (56799 ms total) 2024-04-15T15:02:15.585 INFO:tasks.workunit.client.0.smithi038.stdout: ec_io: [ PASSED ] 2 tests. 2024-04-15T15:02:18.431 INFO:tasks.workunit.client.0.smithi038.stdout:4.352060+0000 mon.a [INF] from='client.54530 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi038-41938-1"}]: dispatch 2024-04-15T15:02:18.431 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.368228+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/4256855001' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi038-41121-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-15T15:02:18.431 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.415866+0000 mon.b [INF] from='client.? v1:172.21.15.38:0/2952358281' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-15T15:02:18.431 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.529078+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/1522000281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi038-40902-16"}]: dispatch 2024-04-15T15:02:18.431 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.557327+0000 client.admin [INF] onexx 2024-04-15T15:02:18.431 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.567729+0000 mon.a [INF] from='client.4975 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.583956+0000 mon.b [INF] from='client.? v1:172.21.15.38:0/964822401' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi038-41201-7"}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.643604+0000 mon.b [INF] from='client.? v1:172.21.15.38:0/1618899301' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi038-40969-10"}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.643817+0000 mon.c [INF] from='client.? v1:172.21.15.38:0/1940054755' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi038-40961-10"}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.650752+0000 mon.a [INF] from='client.4993 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi038-41201-7"}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.677298+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/1522000281' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi038-40902-16"}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.701964+0000 mon.a [INF] from='client.4999 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi038-40969-10"}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.714614+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/1522000281' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi038-40902-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.735067+0000 mon.b [INF] from='client.? v1:172.21.15.38:0/964822401' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi038-41201-7"}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.740935+0000 mon.b [INF] from='client.? v1:172.21.15.38:0/1618899301' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi038-40969-10"}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.745032+0000 mon.a [INF] from='client.54911 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi038-40961-10"}]: dispatch 2024-04-15T15:02:18.432 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:14.869121+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/1815008568' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi038-41332-7"}]: dispatch 2024-04-15T15:02:19.534 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:17.756615+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/1522000281' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi038-40902-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi038-40902-16"}]': finished 2024-04-15T15:02:19.534 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:17.761711+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/4256855001' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi038-41121-4", "overlaypool": "test-rados-api-smithi038-41121-4-cache"}]': finished 2024-04-15T15:02:19.534 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:17.764068+0000 mon.a [INF] from='client.54938 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi038-41085-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-15T15:02:19.534 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.034747+0000 mon.b [INF] from='client.? v1:172.21.15.38:0/4037809433' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi038-41222-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-15T15:02:19.534 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.104025+0000 mon.a [INF] from='client.5032 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi038-41222-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-04-15T15:02:19.534 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.113658+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/4256855001' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi038-41121-4-cache", "mode": "writeback"}]: dispatch 2024-04-15T15:02:19.534 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.427086+0000 mon.b [INF] from='client.? v1:172.21.15.38:0/2952358281' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-15T15:02:19.534 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.458647+0000 client.admin [INF] threexx 2024-04-15T15:02:19.534 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.466337+0000 mon.a [INF] from='client.4975 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-15T15:02:19.535 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.822253+0000 mon.a [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-04-15T15:02:19.535 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.978818+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/1815008568' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi038-41332-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi038-41332-7"}]': finished 2024-04-15T15:02:19.535 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.982995+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/4100846337' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi038-41938-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi038-41938-2"}]': finished 2024-04-15T15:02:19.535 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.985587+0000 mon.a [INF] from='client.4993 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi038-41201-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi038-41201-7"}]': finished 2024-04-15T15:02:19.535 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.988112+0000 mon.a [INF] from='client.54911 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi038-40961-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi038-40961-10"}]': finished 2024-04-15T15:02:19.535 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.991540+0000 mon.a [INF] from='client.4999 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi038-40969-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi038-40969-10"}]': finished 2024-04-15T15:02:23.193 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.994582+0000 mon.a [INF] from='client.5032 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi038-41222-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-15T15:02:23.193 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: got: 2024-04-15T15:02:18.996918+0000 mon.a [INF] from='client.? v1:172.21.15.38:0/4256855001' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi038-41121-4-cache", "mode": "writeback"}]': finished 2024-04-15T15:02:23.193 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8951 ms) 2024-04-15T15:02:23.193 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (64570 ms total) 2024-04-15T15:02:23.193 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: 2024-04-15T15:02:23.193 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [----------] Global test environment tear-down 2024-04-15T15:02:23.194 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (64570 ms total) 2024-04-15T15:02:23.194 INFO:tasks.workunit.client.0.smithi038.stdout: api_cmd: [ PASSED ] 4 tests. 2024-04-15T15:02:28.896 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:28.801+0000 12a5a640 -1 osd.2 59 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:29.932 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:29.920+0000 12a5a640 -1 osd.2 60 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:31.254 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:31.039+0000 12a5a640 -1 osd.2 62 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:31.329 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:04:09.172 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:31.333 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:04:09.176 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:31.388 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:04:09.179 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:31.392 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:04:09.183 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:31.408 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:04:09.251 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:31.425 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:04:09.269 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:31.533 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:04:09.376 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:31.552 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:04:09.343 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:31.596 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:04:09.439 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:02:32.390 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:32.383+0000 12a5a640 -1 osd.2 62 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:33.927 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:33.821+0000 12a5a640 -1 osd.2 63 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:34.078 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:02:34.068+0000 12a5a640 -1 osd.3 67 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4797.0:4 52.b 52:d5b1be37:::aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa:head [writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:35.390 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:35.376+0000 12a5a640 -1 osd.2 65 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:36.860 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:36.719+0000 12a5a640 -1 osd.2 66 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:37.915 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:37.822+0000 12a5a640 -1 osd.2 67 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: Running main() from gmock_main.cc 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [----------] Global test environment set-up. 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ OK ] LibRadosPools.PoolList (5034 ms) 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (4161 ms) 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (4723 ms) 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-04-15T15:02:38.661 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (6891 ms) 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (6534 ms) 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (28450 ms) 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (6117 ms) 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (7028 ms) 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (11204 ms) 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [----------] 9 tests from LibRadosPools (80142 ms total) 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: 2024-04-15T15:02:38.662 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [----------] Global test environment tear-down 2024-04-15T15:02:38.663 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (80142 ms total) 2024-04-15T15:02:38.663 INFO:tasks.workunit.client.0.smithi038.stdout: api_pool: [ PASSED ] 9 tests. 2024-04-15T15:02:38.871 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:38.859+0000 12a5a640 -1 osd.2 67 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:39.969 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:39.946+0000 12a5a640 -1 osd.2 68 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:41.084 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:40.988+0000 12a5a640 -1 osd.2 70 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63:ad551702:::test:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:42.102 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:42.095+0000 12a5a640 -1 osd.2 71 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63:ad551702:::test:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:43.454 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:43.447+0000 12a5a640 -1 osd.2 74 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63:ad551702:::test:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:45.183 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:45.125+0000 12a5a640 -1 osd.2 75 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63:ad551702:::test:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:46.377 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:46.348+0000 12a5a640 -1 osd.2 75 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63:ad551702:::test:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:47.670 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:47.625+0000 12a5a640 -1 osd.2 76 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63:ad551702:::test:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (43009 ms) 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (266 ms) 2024-04-15T15:02:48.171 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (249 ms) 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (784 ms) 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (1788 ms) 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (802 ms) 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (106 ms) 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (297 ms) 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (304 ms) 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-04-15T15:02:48.172 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (273 ms) 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (208 ms) 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (207 ms) 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (429 ms) 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (312 ms) 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (26582 ms) 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (7624 ms) 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (83240 ms total) 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: 2024-04-15T15:02:48.173 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-04-15T15:02:48.174 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (89529 ms total) 2024-04-15T15:02:48.174 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-04-15T15:02:49.024 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:02:49.005+0000 12a5a640 -1 osd.3 81 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.54623.0:3 50.13 50:cfbc2bd5:::oid_PoolQuotaPP_0:head [writefull 0~4096 in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+full_try+supports_pool_eio e43) 2024-04-15T15:02:49.855 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:02:49.792+0000 12a5a640 -1 osd.2 78 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4818.0:2 63.15 63:ad551702:::test:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) 2024-04-15T15:02:50.570 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:02:50.458+0000 12a5a640 -1 osd.3 82 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4815.0:3 67.6 67:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) 2024-04-15T15:02:51.517 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:02:51.485+0000 12a5a640 -1 osd.3 83 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4815.0:3 67.6 67:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) 2024-04-15T15:03:10.481 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: Running main() from gmock_main.cc 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [----------] Global test environment set-up. 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: handle_notify cookie 94283995454864 notify_id 188978561024 notifier_gid 4683 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (54598 ms) 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: Trying... 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: handle_notify cookie 94284008265024 notify_id 395136991232 notifier_gid 4845 2024-04-15T15:03:10.482 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: Waiting for 3.000000000s 2024-04-15T15:03:10.483 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: Timed out. 2024-04-15T15:03:10.483 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: Flushing... 2024-04-15T15:03:10.483 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: Flushed... 2024-04-15T15:03:10.483 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (57014 ms) 2024-04-15T15:03:10.483 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (111612 ms total) 2024-04-15T15:03:10.483 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: 2024-04-15T15:03:10.483 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [----------] Global test environment tear-down 2024-04-15T15:03:10.483 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (111612 ms total) 2024-04-15T15:03:10.483 INFO:tasks.workunit.client.0.smithi038.stdout: watch_notify: [ PASSED ] 2 tests. 2024-04-15T15:03:11.442 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:03:11.403+0000 ea52640 -1 osd.0 100 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54452.0:8 19.3 19:c5aec4bc:test-rados-api-smithi038-41191-4::foo:head [write 0~128 in=128b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e58) 2024-04-15T15:03:12.795 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:03:12.701+0000 ea52640 -1 osd.0 101 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4969.0:2 72.1a 72.db6ee63a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54) 2024-04-15T15:03:13.861 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:03:13.850+0000 ea52640 -1 osd.0 102 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4969.0:2 72.1a 72.db6ee63a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54) 2024-04-15T15:03:15.037 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:03:14.964+0000 ea52640 -1 osd.0 103 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4969.0:2 72.1a 72.db6ee63a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54) 2024-04-15T15:03:19.373 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:03:19.310+0000 ea52640 -1 osd.0 107 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4969.0:2 72.1a 72:5c6776db:::0.obj:head [write 0~170 in=170b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54) 2024-04-15T15:03:23.634 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:23.525+0000 12a5a640 -1 osd.5 112 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.54911.0:1 84.2s0 84.a4975292 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e57) 2024-04-15T15:03:25.032 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:24.944+0000 12a5a640 -1 osd.5 113 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5032.0:8 94.2 94:7af41593:test-rados-api-smithi038-41222-7::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) 2024-04-15T15:03:26.093 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:26.074+0000 12a5a640 -1 osd.5 114 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54809.0:5 59.2 59:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86) 2024-04-15T15:03:27.216 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:27.208+0000 12a5a640 -1 osd.5 115 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54809.0:5 59.2 59:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86) 2024-04-15T15:03:28.475 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:28.434+0000 12a5a640 -1 osd.5 116 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54809.0:5 59.2 59:41780a1c:::tgt_object:head [call test_remote_reads.test_gather in=233b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86) 2024-04-15T15:03:30.278 INFO:tasks.workunit.client.0.smithi038.stdout: cls: Running main() from gmock_main.cc 2024-04-15T15:03:30.278 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-04-15T15:03:30.279 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [----------] Global test environment set-up. 2024-04-15T15:03:30.279 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-04-15T15:03:30.279 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-04-15T15:03:30.279 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [ OK ] NeoRadosCls.DNE (24198 ms) 2024-04-15T15:03:30.279 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-04-15T15:03:30.279 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (107343 ms) 2024-04-15T15:03:30.280 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [----------] 2 tests from NeoRadosCls (131541 ms total) 2024-04-15T15:03:30.280 INFO:tasks.workunit.client.0.smithi038.stdout: cls: 2024-04-15T15:03:30.280 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [----------] Global test environment tear-down 2024-04-15T15:03:30.280 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [==========] 2 tests from 1 test suite ran. (131541 ms total) 2024-04-15T15:03:30.280 INFO:tasks.workunit.client.0.smithi038.stdout: cls: [ PASSED ] 2 tests. 2024-04-15T15:03:31.182 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:31.166+0000 12a5a640 -1 osd.5 118 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54911.0:1 84.2s0 84.a4975292 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e57) 2024-04-15T15:03:32.366 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:32.270+0000 12a5a640 -1 osd.5 119 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54911.0:1 84.2s0 84.a4975292 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e57) 2024-04-15T15:03:32.677 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-04-15T15:03:32.677 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-04-15T15:03:32.677 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-04-15T15:03:32.677 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-04-15T15:03:32.677 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify_test_cb 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (40178 ms) 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93932884359472 err -107 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (3480 ms) 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93932884351568 err -107 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (2485 ms) 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_cb from 4621 notify_id 219043332096 cookie 93932884414816 2024-04-15T15:03:32.678 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (201 ms) 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_cb from 4621 notify_id 219043332096 cookie 93932884414816 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (227 ms) 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_cb from 4621 notify_id 219043332097 cookie 93932884414816 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (602 ms) 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_cb from 4621 notify_id 219043332096 cookie 93932884464288 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_cb from 4621 notify_id 219043332096 cookie 93932884481504 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (448 ms) 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_cb from 4621 notify_id 219043332097 cookie 93932884481504 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_cb from 4621 notify_id 219043332098 cookie 93932884481504 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (38442 ms) 2024-04-15T15:03:32.679 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93932884463088 err -107 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_cb from 4621 notify_id 425201762306 cookie 93932884464224 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (22159 ms) 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93932884464224 err -107 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (7221 ms) 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (115443 ms total) 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: watch_notify_test_cb 2024-04-15T15:03:32.680 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (5623 ms) 2024-04-15T15:03:32.681 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (5623 ms total) 2024-04-15T15:03:32.681 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: 2024-04-15T15:03:32.681 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-04-15T15:03:32.681 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (134141 ms total) 2024-04-15T15:03:32.681 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-04-15T15:03:33.411 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:33.407+0000 12a5a640 -1 osd.5 119 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54911.0:1 84.2s0 84.a4975292 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e57) 2024-04-15T15:03:34.467 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:34.458+0000 12a5a640 -1 osd.5 121 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54911.0:1 84.2s0 84.a4975292 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e57) 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: seed 41332 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (30688 ms) 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (11329 ms) 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (2878 ms) 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-04-15T15:03:35.271 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (90 ms) 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (2023 ms) 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (47008 ms total) 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (59165 ms) 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (217 ms) 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (2815 ms) 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (10382 ms) 2024-04-15T15:03:35.272 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (72579 ms total) 2024-04-15T15:03:35.273 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: 2024-04-15T15:03:35.273 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-04-15T15:03:35.273 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (136692 ms total) 2024-04-15T15:03:35.273 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-04-15T15:03:35.530 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:03:35.498+0000 12a5a640 -1 osd.5 122 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.54911.0:1 84.2s0 84.a4975292 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e57) 2024-04-15T15:03:38.185 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:38.124+0000 12a5a640 -1 osd.3 123 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97.81ea2f16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:39.530 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:39.430+0000 12a5a640 -1 osd.3 124 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97.81ea2f16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:40.625 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:40.540+0000 12a5a640 -1 osd.3 125 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97.81ea2f16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:41.852 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:41.768+0000 12a5a640 -1 osd.3 126 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97.81ea2f16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:42.823 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:42.816+0000 12a5a640 -1 osd.3 127 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97.81ea2f16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:43.827 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:43.821+0000 12a5a640 -1 osd.3 128 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97.81ea2f16 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:44.879 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:44.874+0000 12a5a640 -1 osd.3 128 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97:68f45781:::oid_SimpleWritePP_:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:46.144 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:46.136+0000 12a5a640 -1 osd.3 129 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97:68f45781:::oid_SimpleWritePP_:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:47.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:47.412+0000 12a5a640 -1 osd.3 131 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97:68f45781:::oid_SimpleWritePP_:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:47.867 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:05:25.710 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:03:47.871 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:05:25.714 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:03:47.917 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:05:25.707 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:03:47.922 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:05:25.712 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:03:47.948 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:05:25.792 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:03:47.950 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:05:25.794 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:03:48.210 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:05:26.053 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:03:48.343 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:05:26.186 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:03:48.498 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:05:26.289 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:03:49.488 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:49.477+0000 12a5a640 -1 osd.3 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97:68f45781:::oid_SimpleWritePP_:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:50.585 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:03:50.500+0000 ea52640 -1 osd.0 133 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4969.0:3 72.f 72:f4b50b61:::1.obj:head [write 0~170 in=170b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) 2024-04-15T15:03:50.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:03:50.561+0000 12a5a640 -1 osd.3 133 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.5071.0:2 97.16 97:68f45781:::oid_SimpleWritePP_:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e98) 2024-04-15T15:03:51.877 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:03:51.780+0000 ea52640 -1 osd.0 134 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4969.0:3 72.f 72:f4b50b61:::1.obj:head [write 0~170 in=170b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: notify 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (39805 ms) 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (1027 ms) 2024-04-15T15:04:18.080 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (40832 ms total) 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: notify 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (23664 ms) 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: notify 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (62899 ms) 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (10123 ms) 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (12216 ms) 2024-04-15T15:04:18.081 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 631360192514 notifier_gid 5032 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (2240 ms) 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 631360192515 notifier_gid 5032 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (271 ms) 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 631360192515 notifier_gid 5032 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (1528 ms) 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 635655159812 notifier_gid 5032 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (2312 ms) 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 635655159812 notifier_gid 5032 2024-04-15T15:04:18.082 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (453 ms) 2024-04-15T15:04:18.083 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-04-15T15:04:18.083 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 635655159813 notifier_gid 5032 2024-04-15T15:04:18.083 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (385 ms) 2024-04-15T15:04:18.083 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-04-15T15:04:18.083 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: trying... 2024-04-15T15:04:18.083 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 635655159813 notifier_gid 5032 2024-04-15T15:04:18.083 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: timed out 2024-04-15T15:04:19.202 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: cmd: Running main() from gmock_main.cc 2024-04-15T15:04:19.202 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-04-15T15:04:19.202 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [----------] Global test environment set-up. 2024-04-15T15:04:19.202 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-04-15T15:04:19.202 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-04-15T15:04:19.202 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (6334 ms) 2024-04-15T15:04:19.202 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-04-15T15:04:19.202 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (5931 ms) 2024-04-15T15:04:19.202 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-04-15T15:04:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (168201 ms) 2024-04-15T15:04:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [----------] 3 tests from NeoRadosCmd (180466 ms total) 2024-04-15T15:04:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: 2024-04-15T15:04:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [----------] Global test environment tear-down 2024-04-15T15:04:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [==========] 3 tests from 1 test suite ran. (180467 ms total) 2024-04-15T15:04:19.203 INFO:tasks.workunit.client.0.smithi038.stdout: cmd: [ PASSED ] 3 tests. 2024-04-15T15:04:21.268 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:05:59.111 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:04:21.360 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:05:59.202 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:04:21.697 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:05:59.540 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:04:22.586 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:06:00.430 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:04:22.594 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:06:00.437 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:04:22.595 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:06:00.386 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:04:22.734 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:06:00.525 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:04:22.969 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:06:00.759 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:04:23.092 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:06:00.935 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:04:24.943 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-04-15T15:04:24.943 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [----------] Global test environment set-up. 2024-04-15T15:04:24.943 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [----------] 7 tests from LibRadosList 2024-04-15T15:04:24.943 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-04-15T15:04:24.943 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosList.ListObjects (42346 ms) 2024-04-15T15:04:24.943 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-04-15T15:04:24.943 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (1314 ms) 2024-04-15T15:04:24.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-04-15T15:04:24.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: myset foo1,foo2,foo3 2024-04-15T15:04:24.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo1 2024-04-15T15:04:24.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo2 2024-04-15T15:04:24.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo3 2024-04-15T15:04:24.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: myset foo1,foo4,foo5 2024-04-15T15:04:24.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo4 2024-04-15T15:04:24.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo5 2024-04-15T15:04:24.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo1 2024-04-15T15:04:24.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: myset foo6,foo7 2024-04-15T15:04:24.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo7 2024-04-15T15:04:24.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo6 2024-04-15T15:04:24.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-15T15:04:24.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns1:foo4 2024-04-15T15:04:24.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns1:foo5 2024-04-15T15:04:24.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns2:foo7 2024-04-15T15:04:24.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns2:foo6 2024-04-15T15:04:24.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns1:foo1 2024-04-15T15:04:24.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: :foo1 2024-04-15T15:04:24.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: :foo2 2024-04-15T15:04:24.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: :foo3 2024-04-15T15:04:24.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (5251 ms) 2024-04-15T15:04:24.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-04-15T15:04:24.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 1 0 2024-04-15T15:04:24.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 10 0 2024-04-15T15:04:24.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 13 0 2024-04-15T15:04:24.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 7 0 2024-04-15T15:04:24.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 14 0 2024-04-15T15:04:24.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 0 0 2024-04-15T15:04:24.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 15 0 2024-04-15T15:04:24.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 11 0 2024-04-15T15:04:24.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 5 0 2024-04-15T15:04:24.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 8 0 2024-04-15T15:04:24.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 6 0 2024-04-15T15:04:24.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 3 0 2024-04-15T15:04:24.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 4 0 2024-04-15T15:04:24.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 12 0 2024-04-15T15:04:24.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 9 0 2024-04-15T15:04:24.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 2 0 2024-04-15T15:04:24.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-15T15:04:24.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (125563 ms) 2024-04-15T15:04:24.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-04-15T15:04:24.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: x cursor=MIN 2024-04-15T15:04:24.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=1 cursor=18:02547ec2:::1:head 2024-04-15T15:04:24.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=10 cursor=18:52ea6a34:::10:head 2024-04-15T15:04:24.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=13 cursor=18:566253c9:::13:head 2024-04-15T15:04:24.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=7 cursor=18:5c6b0b28:::7:head 2024-04-15T15:04:24.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=14 cursor=18:62a1935d:::14:head 2024-04-15T15:04:24.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=0 cursor=18:6cac518f:::0:head 2024-04-15T15:04:24.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=15 cursor=18:863748b0:::15:head 2024-04-15T15:04:24.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=11 cursor=18:89d3ae78:::11:head 2024-04-15T15:04:24.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=5 cursor=18:b29083e3:::5:head 2024-04-15T15:04:24.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=8 cursor=18:bd63b0f1:::8:head 2024-04-15T15:04:24.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=6 cursor=18:c4fdafeb:::6:head 2024-04-15T15:04:24.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=3 cursor=18:cfc208b3:::3:head 2024-04-15T15:04:24.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=4 cursor=18:d83876eb:::4:head 2024-04-15T15:04:24.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=12 cursor=18:de5d7c5f:::12:head 2024-04-15T15:04:24.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=9 cursor=18:e960b815:::9:head 2024-04-15T15:04:24.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > oid=2 cursor=18:f905c69b:::2:head 2024-04-15T15:04:24.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: FIRST> seek to MIN oid=1 2024-04-15T15:04:24.951 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=1 cursor=18:02547ec2:::1:head 2024-04-15T15:04:24.951 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:02547ec2:::1:head 2024-04-15T15:04:24.951 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:02547ec2:::1:head -> 1 2024-04-15T15:04:24.951 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=10 cursor=18:52ea6a34:::10:head 2024-04-15T15:04:24.951 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:52ea6a34:::10:head 2024-04-15T15:04:24.951 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:52ea6a34:::10:head -> 10 2024-04-15T15:04:24.951 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=13 cursor=18:566253c9:::13:head 2024-04-15T15:04:24.951 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:566253c9:::13:head 2024-04-15T15:04:24.952 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:566253c9:::13:head -> 13 2024-04-15T15:04:24.952 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=7 cursor=18:5c6b0b28:::7:head 2024-04-15T15:04:24.952 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:5c6b0b28:::7:head 2024-04-15T15:04:24.952 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:5c6b0b28:::7:head -> 7 2024-04-15T15:04:28.716 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : open_pools_parallel: process_1_[41731]: starting. 2024-04-15T15:04:28.716 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_1_[41731]: creating pool ceph_test_rados_open_pools_parallel.smithi038-41666 2024-04-15T15:04:28.716 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_1_[41731]: created object 0... 2024-04-15T15:04:28.716 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_1_[41731]: created object 25... 2024-04-15T15:04:28.716 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_1_[41731]: created object 49... 2024-04-15T15:04:28.716 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_1_[41731]: finishing. 2024-04-15T15:04:28.717 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_1_[41731]: shutting down. 2024-04-15T15:04:28.717 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_2_[41733]: starting. 2024-04-15T15:04:28.717 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_2_[41733]: rados_pool_create. 2024-04-15T15:04:28.717 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_2_[41733]: rados_ioctx_create. 2024-04-15T15:04:28.717 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_2_[41733]: shutting down. 2024-04-15T15:04:28.717 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: ******************************* 2024-04-15T15:04:28.717 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_3_[43240]: starting. 2024-04-15T15:04:28.717 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_3_[43240]: creating pool ceph_test_rados_open_pools_parallel.smithi038-41666 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_3_[43240]: created object 0... 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_3_[43240]: created object 25... 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_3_[43240]: created object 49... 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_3_[43240]: finishing. 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_3_[43240]: shutting down. 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: ******************************* 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_4_[43241]: starting. 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_4_[43241]: rados_pool_create. 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_4_[43241]: rados_ioctx_create. 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: process_4_[43241]: shutting down. 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: ******************************* 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: ******************************* 2024-04-15T15:04:28.718 INFO:tasks.workunit.client.0.smithi038.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-04-15T15:04:30.085 INFO:tasks.workunit.client.0.smithi038.stdout:oid=14 cursor=18:62a1935d:::14:head 2024-04-15T15:04:30.085 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:62a1935d:::14:head 2024-04-15T15:04:30.085 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:62a1935d:::14:head -> 14 2024-04-15T15:04:30.085 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=0 cursor=18:6cac518f:::0:head 2024-04-15T15:04:30.085 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:6cac518f:::0:head 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:6cac518f:::0:head -> 0 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=15 cursor=18:863748b0:::15:head 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:863748b0:::15:head 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:863748b0:::15:head -> 15 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=11 cursor=18:89d3ae78:::11:head 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:89d3ae78:::11:head 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:89d3ae78:::11:head -> 11 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=5 cursor=18:b29083e3:::5:head 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:b29083e3:::5:head 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:b29083e3:::5:head -> 5 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=8 cursor=18:bd63b0f1:::8:head 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:bd63b0f1:::8:head 2024-04-15T15:04:30.086 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:bd63b0f1:::8:head -> 8 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=6 cursor=18:c4fdafeb:::6:head 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:c4fdafeb:::6:head 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:c4fdafeb:::6:head -> 6 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=3 cursor=18:cfc208b3:::3:head 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:cfc208b3:::3:head 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:cfc208b3:::3:head -> 3 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=4 cursor=18:d83876eb:::4:head 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:d83876eb:::4:head 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:d83876eb:::4:head -> 4 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=12 cursor=18:de5d7c5f:::12:head 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:de5d7c5f:::12:head 2024-04-15T15:04:30.087 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:de5d7c5f:::12:head -> 12 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=9 cursor=18:e960b815:::9:head 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:e960b815:::9:head 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:e960b815:::9:head -> 9 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : oid=2 cursor=18:f905c69b:::2:head 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:f905c69b:::2:head 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:f905c69b:::2:head -> 2 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:52ea6a34:::10:head 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:52ea6a34:::10:head expected=18:52ea6a34:::10:head 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:52ea6a34:::10:head -> 10 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=10 expected=10 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:d83876eb:::4:head 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:d83876eb:::4:head expected=18:d83876eb:::4:head 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:d83876eb:::4:head -> 4 2024-04-15T15:04:30.088 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=4 expected=4 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:02547ec2:::1:head 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:02547ec2:::1:head expected=18:02547ec2:::1:head 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:02547ec2:::1:head -> 1 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=1 expected=1 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:f905c69b:::2:head 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:f905c69b:::2:head expected=18:f905c69b:::2:head 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:f905c69b:::2:head -> 2 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=2 expected=2 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:e960b815:::9:head 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:e960b815:::9:head expected=18:e960b815:::9:head 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:e960b815:::9:head -> 9 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=9 expected=9 2024-04-15T15:04:30.089 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:de5d7c5f:::12:head 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:de5d7c5f:::12:head expected=18:de5d7c5f:::12:head 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:de5d7c5f:::12:head -> 12 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=12 expected=12 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:cfc208b3:::3:head 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:cfc208b3:::3:head expected=18:cfc208b3:::3:head 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:cfc208b3:::3:head -> 3 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=3 expected=3 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:c4fdafeb:::6:head 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:c4fdafeb:::6:head expected=18:c4fdafeb:::6:head 2024-04-15T15:04:30.090 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:c4fdafeb:::6:head -> 6 2024-04-15T15:04:32.734 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: api_stat: Running main() from gmock_main.cc 2024-04-15T15:04:32.734 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-04-15T15:04:32.734 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [----------] Global test environment set-up. 2024-04-15T15:04:32.734 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ OK ] LibRadosStat.Stat (32491 ms) 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (7443 ms) 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ OK ] LibRadosStat.StatNS (4485 ms) 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (972 ms) 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (679 ms) 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [----------] 5 tests from LibRadosStat (46070 ms total) 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: 2024-04-15T15:04:32.735 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (95391 ms) 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (14590 ms) 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1618 ms) 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (2192 ms) 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (113791 ms total) 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [----------] Global test environment tear-down 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (194229 ms total) 2024-04-15T15:04:32.736 INFO:tasks.workunit.client.0.smithi038.stdout: api_stat: [ PASSED ] 9 tests. 2024-04-15T15:04:34.545 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_1_[41700]: starting. 2024-04-15T15:04:34.545 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_1_[41700]: creating pool ceph_test_rados_delete_pools_parallel.smithi038-41635 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_1_[41700]: created object 0... 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_1_[41700]: created object 25... 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_1_[41700]: created object 49... 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_1_[41700]: finishing. 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_1_[41700]: shutting down. 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_2_[41701]: starting. 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_2_[41701]: deleting pool ceph_test_rados_delete_pools_parallel.smithi038-41635 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_2_[41701]: shutting down. 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: ******************************* 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_3_[43354]: starting. 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_3_[43354]: creating pool ceph_test_rados_delete_pools_parallel.smithi038-41635 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_3_[43354]: created object 0... 2024-04-15T15:04:34.546 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_3_[43354]: created object 25... 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_3_[43354]: created object 49... 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_3_[43354]: finishing. 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_3_[43354]: shutting down. 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: ******************************* 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_5_[43356]: starting. 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_5_[43356]: listing objects. 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_5_[43356]: listed object 0... 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_5_[43356]: listed object 25... 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_5_[43356]: saw 50 objects 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_5_[43356]: shutting down. 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: ******************************* 2024-04-15T15:04:34.547 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_4_[43355]: starting. 2024-04-15T15:04:34.548 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_4_[43355]: deleting pool ceph_test_rados_delete_pools_parallel.smithi038-41635 2024-04-15T15:04:34.548 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: process_4_[43355]: shutting down. 2024-04-15T15:04:34.548 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: ******************************* 2024-04-15T15:04:34.548 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: ******************************* 2024-04-15T15:04:34.548 INFO:tasks.workunit.client.0.smithi038.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-04-15T15:04:34.974 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: Running main() from gmock_main.cc 2024-04-15T15:04:34.974 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-04-15T15:04:34.974 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [----------] Global test environment set-up. 2024-04-15T15:04:34.974 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-04-15T15:04:34.974 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-04-15T15:04:34.974 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (38465 ms) 2024-04-15T15:04:34.974 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: no timeout :/ 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: no timeout :/ 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: no timeout :/ 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: no timeout :/ 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: no timeout :/ 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (6833 ms) 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (149 ms) 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.Checksum (89 ms) 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-04-15T15:04:34.975 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (218 ms) 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (1632 ms) 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (255 ms) 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (48 ms) 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.TruncTest (90 ms) 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (424 ms) 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (188 ms) 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.RmXattr (478 ms) 2024-04-15T15:04:34.976 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIo.XattrIter (216 ms) 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [----------] 14 tests from LibRadosIo (49085 ms total) 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (109020 ms) 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (3635 ms) 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (290 ms) 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (3061 ms) 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (795 ms) 2024-04-15T15:04:34.977 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (534 ms) 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (2523 ms) 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (262 ms) 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (2451 ms) 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (420 ms) 2024-04-15T15:04:34.978 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [----------] 10 tests from LibRadosIoEC (122991 ms total) 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: Running main() from gmock_main.cc 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [----------] Global test environment set-up. 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (14733 ms) 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLock.LockShared (28086 ms) 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-04-15T15:04:34.979 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1360 ms) 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1300 ms) 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (147 ms) 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLock.Unlock (1772 ms) 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (380 ms) 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (164 ms) 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [----------] 8 tests from LibRadosLock (47942 ms total) 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-04-15T15:04:34.980 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (94508 ms) 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (13053 ms) 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (4687 ms) 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (2935 ms) 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (504 ms) 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (467 ms) 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-04-15T15:04:34.981 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (2584 ms) 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (397 ms) 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (119135 ms total) 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [----------] Global test environment tear-down 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (196574 ms total) 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock: [ PASSED ] 16 tests. 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [----------] Global test environment tear-down 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [==========] 24 tests from 2 test suites ran. (196598 ms total) 2024-04-15T15:04:34.982 INFO:tasks.workunit.client.0.smithi038.stdout: api_io: [ PASSED ] 24 tests. 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: seed 40969 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (40780 ms) 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (793 ms) 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (2077 ms) 2024-04-15T15:04:39.819 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1165 ms) 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (164 ms) 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (375 ms) 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (367 ms) 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (1522 ms) 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (47243 ms total) 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-04-15T15:04:39.820 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (43880 ms) 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (6439 ms) 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (33803 ms) 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (4643 ms) 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (791 ms) 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (17637 ms) 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (8150 ms) 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (408 ms) 2024-04-15T15:04:39.821 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (115751 ms total) 2024-04-15T15:04:39.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: 2024-04-15T15:04:39.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-04-15T15:04:39.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (201406 ms total) 2024-04-15T15:04:39.822 INFO:tasks.workunit.client.0.smithi038.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-04-15T15:04:55.683 INFO:tasks.workunit.client.0.smithi038.stdout: flushing 2024-04-15T15:04:55.683 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: flushed 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3178 ms) 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: trying... 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 644245094406 notifier_gid 5032 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: timed out 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: flushing 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: flushed 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (4966 ms) 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: List watches 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: notify2 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 648540061698 notifier_gid 5032 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: notify2 done 2024-04-15T15:04:55.684 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: watch_check 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: unwatch2 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: flushing 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: done 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3990 ms) 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: List watches 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: notify2 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: handle_notify cookie 94561005821920 notify_id 652835028995 notifier_gid 5032 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: notify2 done 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: watch_check 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: unwatch2 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: flushing 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: done 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (4087 ms) 2024-04-15T15:04:55.685 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (132312 ms total) 2024-04-15T15:04:55.686 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: 2024-04-15T15:04:55.686 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-04-15T15:04:55.686 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (217151 ms total) 2024-04-15T15:04:55.686 INFO:tasks.workunit.client.0.smithi038.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-04-15T15:05:06.332 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:06:44.174 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:05:06.352 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:06:44.195 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:05:06.751 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:06:44.542 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:05:06.772 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:06:44.615 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:05:07.135 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:06:44.925 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:05:07.223 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:06:45.014 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:05:07.567 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:06:45.410 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:05:07.618 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:06:45.461 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:05:08.086 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:06:45.929 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:05:08.388 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_1_[41745]: starting. 2024-04-15T15:05:08.388 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_1_[41745]: creating pool ceph_test_rados_list_parallel.smithi038-41718 2024-04-15T15:05:08.388 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_1_[41745]: created object 0... 2024-04-15T15:05:08.388 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_1_[41745]: created object 25... 2024-04-15T15:05:08.388 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_1_[41745]: created object 49... 2024-04-15T15:05:08.388 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_1_[41745]: finishing. 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_1_[41745]: shutting down. 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_2_[41746]: starting. 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_2_[41746]: listing objects. 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_2_[41746]: listed object 0... 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_2_[41746]: listed object 25... 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_2_[41746]: saw 50 objects 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_2_[41746]: shutting down. 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_3_[45735]: starting. 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_3_[45735]: creating pool ceph_test_rados_list_parallel.smithi038-41718 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_3_[45735]: created object 0... 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_3_[45735]: created object 25... 2024-04-15T15:05:08.389 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_3_[45735]: created object 49... 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_3_[45735]: finishing. 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_3_[45735]: shutting down. 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_4_[45736]: starting. 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_4_[45736]: listing objects. 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_4_[45736]: listed object 0... 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_4_[45736]: listed object 25... 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_4_[45736]: saw 45 objects 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_4_[45736]: shutting down. 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_5_[45737]: starting. 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_5_[45737]: removed 25 objects... 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_5_[45737]: removed half of the objects 2024-04-15T15:05:08.390 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_5_[45737]: removed 50 objects... 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_5_[45737]: removed 50 objects 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_5_[45737]: shutting down. 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_6_[54421]: starting. 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_6_[54421]: creating pool ceph_test_rados_list_parallel.smithi038-41718 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_6_[54421]: created object 0... 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_6_[54421]: created object 25... 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_6_[54421]: created object 49... 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_6_[54421]: finishing. 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_6_[54421]: shutting down. 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_7_[54422]: starting. 2024-04-15T15:05:08.391 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_7_[54422]: listing objects. 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_7_[54422]: listed object 0... 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_7_[54422]: listed object 25... 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_7_[54422]: listed object 50... 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_7_[54422]: saw 55 objects 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_7_[54422]: shutting down. 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_8_[54423]: starting. 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_8_[54423]: added 25 objects... 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_8_[54423]: added half of the objects 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_8_[54423]: added 50 objects... 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_8_[54423]: added 50 objects 2024-04-15T15:05:08.392 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_8_[54423]: shutting down. 2024-04-15T15:05:08.393 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:08.393 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:13.054 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ********************** api_io_pp: Running main() from gmock_main.cc 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [==========] Running 38 tests from 2 test suites. 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [----------] Global test environment set-up. 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [----------] 21 tests from LibRadosIoPP 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: seed 40917 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (38468 ms) 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (1761 ms) 2024-04-15T15:05:13.055 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (1576 ms) 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (141725 ms) 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (50 ms) 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (730 ms) 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (51 ms) 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (760 ms) 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-04-15T15:05:13.056 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (145 ms) 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (113 ms) 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (114 ms) 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (144 ms) 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (100 ms) 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (117 ms) 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (696 ms) 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-04-15T15:05:13.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (1075 ms) 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (129 ms) 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (121 ms) 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (104 ms) 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (167 ms) 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [----------] 21 tests from LibRadosIoPP (188146 ms total) 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (6686 ms) 2024-04-15T15:05:13.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-04-15T15:05:13.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (528 ms) 2024-04-15T15:05:13.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-04-15T15:05:13.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (459 ms) 2024-04-15T15:05:13.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-04-15T15:05:27.475 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] Lib********* 2024-04-15T15:05:27.475 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_9_[59336]: starting. 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_9_[59336]: creating pool ceph_test_rados_list_parallel.smithi038-41718 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_9_[59336]: created object 0... 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_9_[59336]: created object 25... 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_9_[59336]: created object 49... 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_9_[59336]: finishing. 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_9_[59336]: shutting down. 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_10_[59337]: starting. 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_10_[59337]: listing objects. 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_10_[59337]: listed object 0... 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_10_[59337]: listed object 25... 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_10_[59337]: listed object 50... 2024-04-15T15:05:27.476 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_10_[59337]: listed object 75... 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_10_[59337]: saw 98 objects 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_10_[59337]: shutting down. 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_13_[59340]: starting. 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_13_[59340]: removed 25 objects... 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_13_[59340]: removed half of the objects 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_13_[59340]: removed 50 objects... 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_13_[59340]: removed 50 objects 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_13_[59340]: shutting down. 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.477 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_11_[59338]: starting. 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_11_[59338]: added 25 objects... 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_11_[59338]: added half of the objects 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_11_[59338]: added 50 objects... 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_11_[59338]: added 50 objects 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_11_[59338]: shutting down. 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_12_[59339]: starting. 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_12_[59339]: added 25 objects... 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_12_[59339]: added half of the objects 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_12_[59339]: added 50 objects... 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_12_[59339]: added 50 objects 2024-04-15T15:05:27.478 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_12_[59339]: shutting down. 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_14_[64311]: starting. 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_14_[64311]: creating pool ceph_test_rados_list_parallel.smithi038-41718 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_14_[64311]: created object 0... 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_14_[64311]: created object 25... 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_14_[64311]: created object 49... 2024-04-15T15:05:27.479 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_14_[64311]: finishing. 2024-04-15T15:05:27.480 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_14_[64311]: shutting down. 2024-04-15T15:05:27.480 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.480 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.480 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.480 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:27.480 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: starting. 2024-04-15T15:05:27.480 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: listing objects. 2024-04-15T15:05:27.480 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: listed object 0... 2024-04-15T15:05:32.665 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: listed object 2RadosIoECPP.RoundTripPP (3828 ms) 2024-04-15T15:05:32.665 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-04-15T15:05:32.665 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (371 ms) 2024-04-15T15:05:32.665 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-15T15:05:32.665 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (182 ms) 2024-04-15T15:05:32.665 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (341 ms) 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (198 ms) 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (272 ms) 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (179 ms) 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (1183 ms) 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (281 ms) 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-04-15T15:05:32.666 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (604 ms) 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (259 ms) 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (1630 ms) 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (406 ms) 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (294 ms) 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (17701 ms total) 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [----------] Global test environment tear-down 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [==========] 38 tests from 2 test suites ran. (254281 ms total) 2024-04-15T15:05:32.667 INFO:tasks.workunit.client.0.smithi038.stdout: api_io_pp: [ PASSED ] 38 tests. 2024-04-15T15:05:41.684 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: Running main() from gmock_main.cc 2024-04-15T15:05:41.684 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-04-15T15:05:41.684 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [----------] Global test environment set-up. 2024-04-15T15:05:41.684 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-04-15T15:05:41.684 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-04-15T15:05:41.684 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (56987 ms) 2024-04-15T15:05:41.684 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-04-15T15:05:41.685 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (90467 ms) 2024-04-15T15:05:41.685 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-04-15T15:05:41.685 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (115395 ms) 2024-04-15T15:05:41.685 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [----------] 3 tests from NeoradosECList (262849 ms total) 2024-04-15T15:05:41.685 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: 2024-04-15T15:05:41.685 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [----------] Global test environment tear-down 2024-04-15T15:05:41.685 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (262851 ms total) 2024-04-15T15:05:41.685 INFO:tasks.workunit.client.0.smithi038.stdout: ec_list: [ PASSED ] 3 tests. 2024-04-15T15:05:42.293 INFO:tasks.workunit.client.0.smithi038.stdout:5... 2024-04-15T15:05:42.293 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: listed object 50... 2024-04-15T15:05:42.293 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: listed object 75... 2024-04-15T15:05:42.293 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: listed object 100... 2024-04-15T15:05:42.293 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: listed object 125... 2024-04-15T15:05:42.293 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: saw 150 objects 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_15_[64312]: shutting down. 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_16_[64313]: starting. 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_16_[64313]: added 25 objects... 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_16_[64313]: added half of the objects 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_16_[64313]: added 50 objects... 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_16_[64313]: added 50 objects 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: process_16_[64313]: shutting down. 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:42.294 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:42.295 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:42.295 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******************************* 2024-04-15T15:05:42.295 INFO:tasks.workunit.client.0.smithi038.stdout: list_parallel: ******* SUCCESS ********** 2024-04-15T15:05:42.338 INFO:tasks.workunit.client.0.smithi038.stdout: list: Running main() from gmock_main.cc 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [----------] Global test environment set-up. 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [----------] 3 tests from NeoradosList 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [ OK ] NeoradosList.ListObjects (55451 ms) 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [ OK ] NeoradosList.ListObjectsNS (129393 ms) 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [ OK ] NeoradosList.ListObjectsMany (78662 ms) 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [----------] 3 tests from NeoradosList (263506 ms total) 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: 2024-04-15T15:05:42.339 INFO:tasks.workunit.client.0.smithi038.stdout: list: [----------] Global test environment tear-down 2024-04-15T15:05:42.340 INFO:tasks.workunit.client.0.smithi038.stdout: list: [==========] 3 tests from 1 test suite ran. (263506 ms total) 2024-04-15T15:05:42.340 INFO:tasks.workunit.client.0.smithi038.stdout: list: [ PASSED ] 3 tests. 2024-04-15T15:06:04.335 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:07:42.177 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:04.467 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:07:42.310 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:04.654 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:07:42.496 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:04.767 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:07:42.558 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:04.833 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:07:42.677 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:04.902 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:07:42.745 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:05.235 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:07:43.025 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:05.293 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:07:43.136 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:05.351 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:07:43.142 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:29.218 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: Running main() from gmock_main.cc 2024-04-15T15:06:29.218 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-04-15T15:06:29.218 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [----------] Global test environment set-up. 2024-04-15T15:06:29.218 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-04-15T15:06:29.218 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-04-15T15:06:29.218 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (31949 ms) 2024-04-15T15:06:29.218 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-04-15T15:06:29.218 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (89050 ms) 2024-04-15T15:06:29.218 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (7833 ms) 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (31676 ms) 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (13841 ms) 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (25541 ms) 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (110455 ms) 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (310345 ms total) 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [----------] Global test environment tear-down 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (310345 ms total) 2024-04-15T15:06:29.219 INFO:tasks.workunit.client.0.smithi038.stdout: write_operations: [ PASSED ] 7 tests. 2024-04-15T15:06:37.382 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:08:15.224 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:37.467 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:08:15.310 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:37.639 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:08:15.482 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:37.905 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:08:15.748 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:37.950 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:08:15.741 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:38.014 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:08:15.805 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:38.049 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:08:15.892 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:38.416 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:08:16.206 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:38.442 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:08:16.286 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:06:46.864 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-04-15T15:06:46.864 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-04-15T15:06:46.864 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-04-15T15:06:46.864 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-04-15T15:06:46.864 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (46299 ms) 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (34831 ms) 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (78410 ms) 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (25675 ms) 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-04-15T15:06:46.865 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (24279 ms) 2024-04-15T15:06:46.866 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-04-15T15:06:46.866 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (24193 ms) 2024-04-15T15:06:46.866 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-04-15T15:06:46.866 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (94527 ms) 2024-04-15T15:06:46.866 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (328214 ms total) 2024-04-15T15:06:46.866 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: 2024-04-15T15:06:46.866 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-04-15T15:06:46.866 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (328214 ms total) 2024-04-15T15:06:46.866 INFO:tasks.workunit.client.0.smithi038.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-04-15T15:06:55.943 INFO:tasks.workunit.client.0.smithi038.stdout: misc: Running main() from gmock_main.cc 2024-04-15T15:06:55.943 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-04-15T15:06:55.943 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [----------] Global test environment set-up. 2024-04-15T15:06:55.944 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-04-15T15:06:55.944 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-04-15T15:06:55.944 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.Version (6022 ms) 2024-04-15T15:06:55.944 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-04-15T15:06:55.944 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (4943 ms) 2024-04-15T15:06:55.944 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-04-15T15:06:55.945 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.LongName (68878 ms) 2024-04-15T15:06:55.945 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-04-15T15:06:55.945 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (70963 ms) 2024-04-15T15:06:55.945 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-04-15T15:06:55.945 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (27256 ms) 2024-04-15T15:06:55.945 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-04-15T15:06:55.945 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (24446 ms) 2024-04-15T15:06:55.945 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.Exec (23037 ms) 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (27609 ms) 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (26087 ms) 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.BigObject (25716 ms) 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (12301 ms) 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (19838 ms) 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [----------] 12 tests from NeoRadosMisc (337096 ms total) 2024-04-15T15:06:55.946 INFO:tasks.workunit.client.0.smithi038.stdout: misc: 2024-04-15T15:06:55.947 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [----------] Global test environment tear-down 2024-04-15T15:06:55.947 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [==========] 12 tests from 1 test suite ran. (337096 ms total) 2024-04-15T15:06:55.947 INFO:tasks.workunit.client.0.smithi038.stdout: misc: [ PASSED ] 12 tests. 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: Running main() from gmock_main.cc 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] Global test environment set-up. 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (18643 ms) 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (33597 ms) 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-04-15T15:07:04.669 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (23377 ms) 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (36148 ms) 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (111765 ms total) 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (24450 ms) 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (9102 ms) 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (17006 ms) 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (50558 ms total) 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: 2024-04-15T15:07:04.670 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (16147 ms) 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (13996 ms) 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (12122 ms) 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (12287 ms) 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (54552 ms total) 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-15T15:07:04.671 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (25211 ms) 2024-04-15T15:07:04.672 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-15T15:07:04.672 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (22196 ms) 2024-04-15T15:07:04.672 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (47407 ms total) 2024-04-15T15:07:04.672 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: 2024-04-15T15:07:04.672 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [----------] Global test environment tear-down 2024-04-15T15:07:04.672 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (346173 ms total) 2024-04-15T15:07:04.672 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout:e494a0d530 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2a680 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a28e00 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2b190 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2bc90 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2a490 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2cc80 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2b980 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2d850 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2dff0 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2e740 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2ee90 2024-04-15T15:07:07.824 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2f960 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2c870 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2ca70 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a30e80 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a2f730 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b0b70 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e494a30ad0 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b1680 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b2160 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b0900 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b30e0 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b1e10 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b3c30 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b4380 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b4a70 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b54e0 2024-04-15T15:07:07.825 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b2e60 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: waiting 0x55e4952b6080 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: done. 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (54978 ms) 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (54978 ms total) 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMisc.Exec (93775 ms) 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (2359 ms) 2024-04-15T15:07:07.826 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (2666 ms) 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5804 ms) 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (184084 ms) 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] 8 tests from LibRadosMisc (288688 ms total) 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [----------] Global test environment tear-down 2024-04-15T15:07:07.827 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (349344 ms total) 2024-04-15T15:07:07.828 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc: [ PASSED ] 12 tests. 2024-04-15T15:07:11.405 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:08:49.248 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:11.408 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:08:49.198 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:11.411 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:08:49.202 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:11.411 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:08:49.253 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:11.417 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:08:49.260 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:11.419 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:08:49.263 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:11.557 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:08:49.400 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:11.565 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:08:49.356 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:11.600 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:08:49.443 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: Running main() from gmock_main.cc 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [----------] Global test environment set-up. 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [----------] 14 tests from NeoRadosIo 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.Limits (54472 ms) 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (63948 ms) 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.ReadOp (41292 ms) 2024-04-15T15:07:25.640 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.SparseRead (17821 ms) 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.RoundTrip (36747 ms) 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (24943 ms) 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (29621 ms) 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (23789 ms) 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (22241 ms) 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.Trunc (25509 ms) 2024-04-15T15:07:25.641 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.Remove (8762 ms) 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (6667 ms) 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.RmXattr (6898 ms) 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ OK ] NeoRadosIo.GetXattrs (4129 ms) 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [----------] 14 tests from NeoRadosIo (366839 ms total) 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [----------] Global test environment tear-down 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [==========] 14 tests from 1 test suite ran. (366840 ms total) 2024-04-15T15:07:25.642 INFO:tasks.workunit.client.0.smithi038.stdout: io: [ PASSED ] 14 tests. 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: Running main() from gmock_main.cc 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [----------] Global test environment set-up. 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (54367 ms) 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (14231 ms) 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (36841 ms) 2024-04-15T15:07:30.791 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (74595 ms) 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (23289 ms) 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (22417 ms) 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (27404 ms) 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (22679 ms) 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (23400 ms) 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (18196 ms) 2024-04-15T15:07:30.792 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (22895 ms) 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (16695 ms) 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (7706 ms) 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (7207 ms) 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (371923 ms total) 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [----------] Global test environment tear-down 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (371923 ms total) 2024-04-15T15:07:30.793 INFO:tasks.workunit.client.0.smithi038.stdout: read_operations: [ PASSED ] 14 tests. 2024-04-15T15:07:31.641 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:09.483 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:31.646 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:09.489 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:31.709 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:09.498 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:31.720 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:09.563 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:31.723 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:09.565 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:31.728 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:09.571 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:31.728 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:09.519 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:31.790 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:09.633 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:31.813 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:09.603 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:41.723 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-04-15T15:07:41.723 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-04-15T15:07:41.724 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-04-15T15:07:41.724 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-04-15T15:07:41.724 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-04-15T15:07:41.724 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-15T15:07:41.724 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: 2024-04-15T15:07:41.724 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-04-15T15:07:41.724 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: seed 41089 2024-04-15T15:07:41.724 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-04-15T15:07:41.725 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (23 ms) 2024-04-15T15:07:41.725 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-04-15T15:07:41.725 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (44793 ms) 2024-04-15T15:07:41.725 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-04-15T15:07:41.725 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (488 ms) 2024-04-15T15:07:41.725 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-04-15T15:07:41.725 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (1784 ms) 2024-04-15T15:07:41.725 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-04-15T15:07:41.726 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (426 ms) 2024-04-15T15:07:41.726 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-04-15T15:07:41.726 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (89 ms) 2024-04-15T15:07:41.726 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-04-15T15:07:41.726 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (59 ms) 2024-04-15T15:07:41.726 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-04-15T15:07:41.726 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (224 ms) 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (382 ms) 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (255 ms) 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (51 ms) 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (149 ms) 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (262 ms) 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: osd_max_attr_size = 0 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (210072 ms) 2024-04-15T15:07:41.727 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (10896 ms) 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: done waiting, doing copies 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: waiting for final deep scrubs... 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: done waiting 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (102249 ms) 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (760 ms) 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (223 ms) 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (5623 ms) 2024-04-15T15:07:41.728 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-04-15T15:07:41.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-04-15T15:07:41.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-04-15T15:07:41.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-04-15T15:07:41.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-04-15T15:07:41.729 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-04-15T15:07:47.185 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] snapshots: Running main() from gmock_main.cc 2024-04-15T15:07:47.185 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [----------] Global test environment set-up. 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (57010 ms) 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (74513 ms) 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (18684 ms) 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (11450 ms) 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-04-15T15:07:47.186 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (57245 ms) 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (218903 ms total) 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (39320 ms) 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (47317 ms) 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (41389 ms) 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (12734 ms) 2024-04-15T15:07:47.187 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (7104 ms) 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi038-42029-11. 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: Waiting for snaps to purge. 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (21561 ms) 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (169426 ms total) 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [----------] Global test environment tear-down 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (388329 ms total) 2024-04-15T15:07:47.188 INFO:tasks.workunit.client.0.smithi038.stdout: snapshots: [ PASSED ] 11 tests. 2024-04-15T15:07:48.248 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-04-15T15:07:48.248 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-04-15T15:07:48.248 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: seed 41191 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (48207 ms) 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (7161 ms) 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (101185 ms) 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (22452 ms) 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (28770 ms) 2024-04-15T15:07:48.249 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (207775 ms total) 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (22782 ms) 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (26135 ms) 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (35744 ms) 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (17218 ms) 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (5083 ms) 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-15T15:07:48.250 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3080-gc2d8c315/rpm/el9/BUILD/ceph-19.0.0-3080-gc2d8c315/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi038-41191-7 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: waiting for snaps to purge 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (22702 ms) 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (129664 ms total) 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (8 ms) 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5523 ms) 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5531 ms total) 2024-04-15T15:07:48.251 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: 2024-04-15T15:07:48.252 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-04-15T15:07:48.252 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-04-15T15:07:48.252 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (4898 ms) 2024-04-15T15:07:48.252 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-15T15:07:51.809 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:29.652 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:51.814 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:29.657 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:51.826 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:29.669 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:51.829 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:29.620 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:51.830 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:29.674 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:51.837 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:29.628 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:51.974 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:29.817 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:51.993 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:29.836 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:07:51.995 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:29.786 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:03.944 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] Li api_aio: Running main() from gmock_main.cc 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [----------] Global test environment set-up. 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.TooBig (5141 ms) 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (50670 ms) 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (15849 ms) 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (25953 ms) 2024-04-15T15:08:03.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (64490 ms) 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (12705 ms) 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (25947 ms) 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (25470 ms) 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (29377 ms) 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (24119 ms) 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (26241 ms) 2024-04-15T15:08:03.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (22696 ms) 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (17177 ms) 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (6694 ms) 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.Flush (3689 ms) 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (6068 ms) 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (4969 ms) 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3114 ms) 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-04-15T15:08:03.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (5107 ms) 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3310 ms) 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (4095 ms) 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3643 ms) 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (4333 ms) 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (5023 ms) 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (4696 ms) 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-04-15T15:08:03.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (5002 ms) 2024-04-15T15:08:03.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [----------] 26 tests from LibRadosAio (405578 ms total) 2024-04-15T15:08:03.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: 2024-04-15T15:08:03.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-04-15T15:08:11.840 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC. api_aio_pp: Running main() from gmock_main.cc 2024-04-15T15:08:11.840 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-04-15T15:08:11.840 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-04-15T15:08:11.840 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-04-15T15:08:11.840 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-04-15T15:08:11.840 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (5124 ms) 2024-04-15T15:08:11.840 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-04-15T15:08:11.840 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (100945 ms) 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (53742 ms) 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (18176 ms) 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (29060 ms) 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (29591 ms) 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (22229 ms) 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (24263 ms) 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-04-15T15:08:11.841 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (25609 ms) 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (22217 ms) 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (16433 ms) 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (4148 ms) 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (4672 ms) 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (6015 ms) 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (5038 ms) 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (4135 ms) 2024-04-15T15:08:11.842 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (4024 ms) 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (4367 ms) 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3151 ms) 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3644 ms) 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (4245 ms) 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (4039 ms) 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-04-15T15:08:11.843 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3062 ms) 2024-04-15T15:08:11.844 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-04-15T15:08:11.844 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3913 ms) 2024-04-15T15:08:11.844 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-04-15T15:08:11.844 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3738 ms) 2024-04-15T15:08:11.844 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-04-15T15:08:11.844 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (4377 ms) 2024-04-15T15:08:11.844 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-04-15T15:08:11.926 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:49.769 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:11.996 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:49.838 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:12.051 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:49.842 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:12.056 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:49.847 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:12.065 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:49.909 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:12.067 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:49.910 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:12.089 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:49.932 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:12.107 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:49.897 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:12.122 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:49.966 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:16.902 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] L22 tests from LibRadosMiscPP (378808 ms total) 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (7913 ms) 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (7913 ms total) 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (739 ms) 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (94 ms) 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (833 ms total) 2024-04-15T15:08:16.903 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (742 ms) 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (81 ms) 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (823 ms total) 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (709 ms) 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (70 ms) 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (779 ms total) 2024-04-15T15:08:16.904 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: 2024-04-15T15:08:16.905 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-04-15T15:08:16.905 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-04-15T15:08:16.905 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1755 ms) 2024-04-15T15:08:16.905 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1755 ms total) 2024-04-15T15:08:16.905 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: 2024-04-15T15:08:16.905 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-04-15T15:08:16.905 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (418419 ms total) 2024-04-15T15:08:16.905 INFO:tasks.workunit.client.0.smithi038.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-04-15T15:08:18.579 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:56.421 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:18.583 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:56.426 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:18.622 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:09:56.464 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:18.658 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:56.449 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:18.660 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:56.450 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:18.689 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:56.532 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:18.691 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:56.534 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:18.691 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:09:56.481 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:18.725 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:09:56.568 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout:bRadosSnapshotsECPP.SnapRemovePP (2041 ms) 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (5966 ms) 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2573 ms) 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (15478 ms total) 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (6280 ms) 2024-04-15T15:08:20.178 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3970 ms) 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3809 ms) 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (14059 ms total) 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (421640 ms total) 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-04-15T15:08:20.179 INFO:tasks.workunit.client.0.smithi038.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-15T15:08:31.949 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:10:09.791 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:31.951 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:10:09.794 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:31.983 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:10:09.826 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:31.998 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:10:09.788 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:31.999 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:10:09.790 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:32.026 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:10:09.869 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:32.028 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:10:09.871 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:32.029 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:10:09.820 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:32.070 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:10:09.913 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:52.133 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:10:29.976 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:52.148 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:10:29.990 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:52.198 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:10:30.041 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:52.199 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:10:29.989 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:52.213 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:10:30.056 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:52.218 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:10:30.009 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:52.238 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:10:30.081 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:52.270 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:10:30.114 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:08:52.282 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:10:30.072 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:11.343 INFO:tasks.workunit.client.0.smithi038.stdout:: entry=6 expected=6 2024-04-15T15:09:11.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:bd63b0f1:::8:head 2024-04-15T15:09:11.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:bd63b0f1:::8:head expected=18:bd63b0f1:::8:head 2024-04-15T15:09:11.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:bd63b0f1:::8:head -> 8 2024-04-15T15:09:11.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=8 expected=8 2024-04-15T15:09:11.343 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:b29083e3:::5:head 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:b29083e3:::5:head expected=18:b29083e3:::5:head 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:b29083e3:::5:head -> 5 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=5 expected=5 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:89d3ae78:::11:head 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:89d3ae78:::11:head expected=18:89d3ae78:::11:head 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:89d3ae78:::11:head -> 11 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=11 expected=11 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:863748b0:::15:head 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:863748b0:::15:head expected=18:863748b0:::15:head 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:863748b0:::15:head -> 15 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=15 expected=15 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:6cac518f:::0:head 2024-04-15T15:09:11.344 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:6cac518f:::0:head expected=18:6cac518f:::0:head 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:6cac518f:::0:head -> 0 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=0 expected=0 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:5c6b0b28:::7:head 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:5c6b0b28:::7:head expected=18:5c6b0b28:::7:head 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:5c6b0b28:::7:head -> 7 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=7 expected=7 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:566253c9:::13:head 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:566253c9:::13:head expected=18:566253c9:::13:head 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:566253c9:::13:head -> 13 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=13 expected=13 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : seek to 18:62a1935d:::14:head 2024-04-15T15:09:11.345 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : cursor()=18:62a1935d:::14:head expected=18:62a1935d:::14:head 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: > 18:62a1935d:::14:head -> 14 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: : entry=14 expected=14 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (18671 ms) 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (241488 ms) 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: split 0/5 -> MIN 18:33333333::::head 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: split 1/5 -> 18:33333333::::head 18:66666666::::head 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: split 2/5 -> 18:66666666::::head 18:99999999::::head 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: split 3/5 -> 18:99999999::::head 18:cccccccc::::head 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: split 4/5 -> 18:cccccccc::::head MAX 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (27203 ms) 2024-04-15T15:09:11.346 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [----------] 7 tests from LibRadosList (461836 ms total) 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1848 ms) 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: myset foo1,foo2,foo3 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo1 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo2 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo3 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: myset foo1,foo4,foo5 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo4 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo5 2024-04-15T15:09:11.347 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo1 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: myset foo6,foo7 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo7 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: foo6 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns1:foo4 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns1:foo5 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns2:foo7 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns2:foo6 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: ns1:foo1 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: :foo1 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: :foo2 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: :foo3 2024-04-15T15:09:11.348 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (1260 ms) 2024-04-15T15:09:12.195 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:10:50.038 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:12.200 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:10:49.990 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:12.202 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:10:50.045 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:12.203 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:10:49.993 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:12.249 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:10:50.039 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:12.252 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:10:50.096 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:12.256 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:10:50.099 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:12.256 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:10:50.099 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:12.306 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:10:50.149 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:19.867 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-04-15T15:09:19.867 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 1 0 2024-04-15T15:09:19.867 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 10 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 13 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 7 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 14 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 0 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 15 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 11 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 5 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 8 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 6 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 3 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 4 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 12 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 9 0 2024-04-15T15:09:19.868 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 2 0 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (2357 ms) 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [----------] 3 tests from LibRadosListEC (5465 ms total) 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3380 ms) 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [----------] 1 test from LibRadosListNP (3380 ms total) 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [----------] Global test environment tear-down 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [==========] 11 tests from 3 test suites ran. (481442 ms total) 2024-04-15T15:09:19.869 INFO:tasks.workunit.client.0.smithi038.stdout: api_list: [ PASSED ] 11 tests. 2024-04-15T15:09:32.377 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:10.219 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:32.442 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:10.285 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:32.445 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:10.288 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:32.503 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:10.294 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:32.504 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:10.347 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:32.505 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:10.295 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:32.515 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:10.357 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:32.557 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:10.348 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:32.571 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:10.414 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:52.356 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:30.198 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:52.370 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:30.213 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:52.409 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:30.199 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:52.410 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:30.200 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:52.410 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:30.253 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:52.411 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:30.254 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:52.431 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:30.274 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:52.453 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:30.243 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:09:52.453 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:30.296 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout:SimpleWrite 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7895 ms) 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7268 ms) 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (10188 ms) 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7332 ms) 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-04-15T15:10:05.115 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7242 ms) 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7897 ms) 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6506 ms) 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7353 ms) 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7484 ms) 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7836 ms) 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6837 ms) 2024-04-15T15:10:05.116 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7862 ms) 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6722 ms) 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (8059 ms) 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7094 ms) 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7592 ms) 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (121167 ms total) 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [----------] Global test environment tear-down 2024-04-15T15:10:05.117 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (526745 ms total) 2024-04-15T15:10:05.118 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio: [ PASSED ] 42 tests. 2024-04-15T15:10:12.443 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:50.285 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:12.495 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:50.338 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:12.539 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:50.381 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:12.542 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:50.332 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:12.545 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:50.335 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:12.548 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:50.391 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:12.549 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:50.392 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:12.586 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:50.377 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:12.608 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:50.451 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:15.615 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:53.458 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:15.687 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:53.477 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:15.688 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:53.531 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:15.694 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:53.484 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:15.699 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:53.543 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:15.701 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:53.545 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:15.718 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:11:53.509 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:15.720 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:11:53.563 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:15.812 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:11:53.655 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:32.729 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:12:10.572 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:32.735 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:12:10.578 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:32.768 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:12:10.611 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:32.781 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:12:10.571 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:32.783 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:12:10.573 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:32.786 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:12:10.630 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:32.788 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:12:10.631 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:32.821 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:12:10.665 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:32.824 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:12:10.614 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:49.024 INFO:tasks.workunit.client.0.smithi038.stdout:ibRadosAio.RoundTripAppendPP (3510 ms) 2024-04-15T15:10:49.024 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-04-15T15:10:49.024 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3271 ms) 2024-04-15T15:10:49.024 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-04-15T15:10:49.024 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (2833 ms) 2024-04-15T15:10:49.024 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3215 ms) 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: setting pool EIO 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: max_success 50, min_failed 51 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (5630 ms) 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (4416 ms) 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (432833 ms total) 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3330 ms) 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-04-15T15:10:49.025 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (10445 ms) 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (16595 ms) 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (2992 ms) 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (33362 ms total) 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3676 ms) 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3676 ms total) 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: 2024-04-15T15:10:49.026 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (15165 ms) 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7741 ms) 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7197 ms) 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7368 ms) 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (2718 ms) 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7282 ms) 2024-04-15T15:10:49.027 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7214 ms) 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7894 ms) 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (8034 ms) 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7010 ms) 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7779 ms) 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7871 ms) 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-15T15:10:49.028 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7507 ms) 2024-04-15T15:10:52.873 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:12:30.715 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:52.876 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:12:30.718 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:52.933 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:12:30.776 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:52.940 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:12:30.730 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:52.941 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:12:30.732 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:52.953 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:12:30.796 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:52.956 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:12:30.799 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:53.000 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:12:30.790 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:10:53.017 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:12:30.861 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:12.946 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:12:50.788 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:12.948 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:12:50.791 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:12.998 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:12:50.841 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:13.011 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:12:50.802 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:13.015 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:12:50.805 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:13.022 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:12:50.865 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:13.026 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:12:50.869 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:13.065 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:12:50.856 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:13.067 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:12:50.910 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:32.999 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:10.841 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:33.062 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:10.904 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:33.127 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:10.917 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:33.128 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:10.971 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:33.130 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:10.973 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:33.131 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:10.922 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:33.161 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:11.004 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:33.181 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:11.024 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:33.188 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:10.978 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:36.268 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3405 ms) 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6386 ms) 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7257 ms) 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7987 ms) 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7562 ms) 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-04-15T15:11:36.269 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (6631 ms) 2024-04-15T15:11:36.270 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-04-15T15:11:36.270 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (8014 ms) 2024-04-15T15:11:36.270 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (148022 ms total) 2024-04-15T15:11:36.270 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: 2024-04-15T15:11:36.270 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-04-15T15:11:36.270 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (617894 ms total) 2024-04-15T15:11:36.270 INFO:tasks.workunit.client.0.smithi038.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-04-15T15:11:52.977 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:30.819 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:53.025 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:30.815 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:53.028 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:30.819 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:53.029 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:30.872 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:53.060 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:30.850 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:53.080 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:30.923 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:53.081 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:30.925 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:53.087 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:30.930 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:11:53.132 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:30.975 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:08.029 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:45.872 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:08.079 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:45.922 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:08.106 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:45.948 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:08.123 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:45.913 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:08.124 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:45.915 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:08.130 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:45.973 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:08.131 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:45.975 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:08.152 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:45.942 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:08.158 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:46.001 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:13.186 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:51.029 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:13.191 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:51.034 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:13.205 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:51.048 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:13.241 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:51.084 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:13.244 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:51.087 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:13.255 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:51.046 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:13.258 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:51.049 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:13.264 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:51.107 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:13.276 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:51.066 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:14.181 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:51.972 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:14.182 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:51.973 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:14.199 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:13:51.990 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:14.342 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:52.185 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:14.347 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:52.190 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:14.365 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:13:52.208 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:14.408 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:52.251 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:14.409 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:52.252 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:14.429 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:13:52.272 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:23.153 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:00.995 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:23.155 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:00.998 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:23.176 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:01.018 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:23.202 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:00.992 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:23.203 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:00.993 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:23.207 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:01.050 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:23.208 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:01.052 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:23.222 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:01.013 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:23.236 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:01.079 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:33.236 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:11.078 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:33.238 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:11.081 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:33.262 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:11.105 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:33.286 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:11.077 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:33.288 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:11.078 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:33.293 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:11.136 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:33.295 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:11.138 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:33.308 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:11.099 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:33.325 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:11.168 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:34.719 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-04-15T15:12:34.719 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-04-15T15:12:34.719 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-04-15T15:12:34.719 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: seed 41121 2024-04-15T15:12:34.719 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-04-15T15:12:34.719 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (27718 ms) 2024-04-15T15:12:34.719 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-04-15T15:12:34.719 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (85005 ms) 2024-04-15T15:12:34.719 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (10210 ms) 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (122933 ms total) 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (63826 ms) 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (60035 ms) 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (70818 ms) 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: my_snaps [3] 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: my_snaps [4,3] 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: my_snaps [5,4,3] 2024-04-15T15:12:34.720 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: promoting some heads 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: promoting from clones for snap 6 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: promoting from clones for snap 5 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: promoting from clones for snap 4 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: promoting from clones for snap 3 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: waiting for scrubs... 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: done waiting 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (178458 ms) 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (11363 ms) 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (9284 ms) 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-15T15:12:34.721 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (9221 ms) 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (10384 ms) 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (11130 ms) 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (10124 ms) 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (12306 ms) 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (40222 ms) 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (9762 ms) 2024-04-15T15:12:34.722 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-04-15T15:12:34.723 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (10561 ms) 2024-04-15T15:12:34.723 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-04-15T15:12:34.723 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (15364 ms) 2024-04-15T15:12:34.723 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-15T15:12:34.723 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (9712 ms) 2024-04-15T15:12:34.723 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-15T15:12:34.723 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (11868 ms) 2024-04-15T15:12:38.249 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:16.091 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:38.250 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:16.093 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:38.269 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:16.111 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:38.295 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:16.085 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:38.296 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:16.086 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:38.303 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:16.146 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:38.304 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:16.147 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:38.309 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:16.099 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:38.318 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:16.162 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:53.382 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:31.221 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:53.382 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:31.223 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:53.422 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:31.265 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:53.445 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:31.235 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:53.450 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:31.240 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:53.459 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:31.303 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:53.462 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:31.306 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:53.476 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:31.267 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:53.491 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:31.335 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:12:56.739 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: hmm, no HitSet yet 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: ok, hit_set contains 282:602f83fe:::foo:head 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9815 ms) 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg_num = 32 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 0 ls 1713193972,0 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 1 ls 1713193971,0 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 2 ls 1713193972,0 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 3 ls 1713193972,0 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 4 ls 1713193972,0 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 5 ls 1713193971,0 2024-04-15T15:12:56.740 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 6 ls 1713193971,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 7 ls 1713193972,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 8 ls 1713193972,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 9 ls 1713193971,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 10 ls 1713193971,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 11 ls 1713193972,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 12 ls 1713193972,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 13 ls 1713193971,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 14 ls 1713193972,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 15 ls 1713193972,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 16 ls 1713193972,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 17 ls 1713193972,0 2024-04-15T15:12:56.741 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 18 ls 1713193972,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 19 ls 1713193972,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 20 ls 1713193972,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 21 ls 1713193972,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 22 ls 1713193971,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 23 ls 1713193972,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 24 ls 1713193972,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 25 ls 1713193972,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 26 ls 1713193971,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 27 ls 1713193971,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 28 ls 1713193971,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 29 ls 1713193971,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 30 ls 1713193972,0 2024-04-15T15:12:56.742 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg 31 ls 1713193971,0 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: pg_num = 32 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:6cac518f:::0:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:02547ec2:::1:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:f905c69b:::2:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:cfc208b3:::3:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d83876eb:::4:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:b29083e3:::5:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c4fdafeb:::6:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:5c6b0b28:::7:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:bd63b0f1:::8:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:e960b815:::9:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:52ea6a34:::10:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:89d3ae78:::11:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:de5d7c5f:::12:head 2024-04-15T15:12:56.743 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:566253c9:::13:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:62a1935d:::14:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:863748b0:::15:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:3958e169:::16:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:4d4dabf9:::17:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:8391935d:::18:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:28883081:::19:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:69259c59:::20:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:4bdb80b7:::21:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:a11c5d71:::22:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:271af37b:::23:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:95b121be:::24:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:58d1031b:::25:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:0a050783:::26:head 2024-04-15T15:12:56.744 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c709704c:::27:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:cbe56eaf:::28:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:86b4b162:::29:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:70d89383:::30:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:dd450c7c:::31:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:6d5729b1:::32:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c388f3fb:::33:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:56cfea31:::34:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:9dbc1bf7:::35:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:40b74ccd:::36:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:4d5aaf42:::37:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:920f362c:::38:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:6cc53222:::39:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:9cad833f:::40:head 2024-04-15T15:12:56.745 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:1ea84d41:::41:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c4480ef6:::42:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:a694361e:::43:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d1bd33e9:::44:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:ddc2cd5d:::45:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:2b782207:::46:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:7b187fca:::47:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:90ecdf6f:::48:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:a5ed95fe:::49:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:ea0eaa55:::50:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:f33ef17b:::51:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:a0d1b2f6:::52:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:60c5229e:::53:head 2024-04-15T15:12:56.746 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:edcbc575:::54:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:102cf253:::55:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:efb7fb0b:::56:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:50d0a326:::57:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d4dc5daf:::58:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:3a130462:::59:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:ec87ed71:::60:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d5bc9454:::61:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:3ddfe313:::62:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:7c2816b9:::63:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:47e00e4d:::64:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c6410c18:::65:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:b48ed237:::66:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:cd63ad31:::67:head 2024-04-15T15:12:56.747 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:b179e92b:::68:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:0d9f741a:::69:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:6d3352ae:::70:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c6d5c19e:::71:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:bc4729c3:::72:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:77e930b9:::73:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:0abeecfd:::74:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:b7c37e15:::75:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:b6378398:::76:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:02bd68de:::77:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:cc795d2d:::78:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:630d4fea:::79:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:e0d29ef5:::80:head 2024-04-15T15:12:56.748 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:fd6f13d2:::81:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:606461d5:::82:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:eadbdc43:::83:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:8761d0bb:::84:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:9ef0186f:::85:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:e0d41294:::86:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:961de695:::87:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:1423148f:::88:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:633a8fa2:::89:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:a8653809:::90:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:3dac8b33:::91:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:35aad435:::92:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:f6dcc343:::93:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:dbbdad87:::94:head 2024-04-15T15:12:56.749 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:1cb48ce0:::95:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:03cd461c:::96:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:17a4ea99:::97:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:9993c9a7:::98:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:6394211c:::99:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:94c7ae57:::100:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:6fdee5bb:::101:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:9a477fd1:::102:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:eb850916:::103:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:affc56b9:::104:head 2024-04-15T15:12:56.750 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:b42dc814:::105:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:f319f8f0:::106:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:9a40b9de:::107:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:8b524f28:::108:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:e3de589f:::109:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:90f90a5b:::110:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:a7b4f1d7:::111:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:af51766e:::112:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:b6f90bd1:::113:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:e0261208:::114:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c9569ef7:::115:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:61bebe50:::116:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:fe93412b:::117:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d3d38bee:::118:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:3100ba0c:::119:head 2024-04-15T15:12:56.751 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d0560ada:::120:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:f0ea8b35:::121:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:766f231a:::122:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:a07a2582:::123:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:bd7c6b3a:::124:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:fb2ddaff:::125:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:4408e1fe:::126:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:ee1df7a7:::127:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c3002909:::128:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:4f48ffa9:::129:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:edf38733:::130:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c08425c0:::131:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:5f902d98:::132:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:41ea2c93:::133:head 2024-04-15T15:12:56.752 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:813cee13:::134:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:0131818d:::135:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:26ba5a85:::136:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:381b8a5a:::137:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:28797e47:::138:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:bfca7f22:::139:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:36807075:::140:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:80b03975:::141:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:5c15709b:::142:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:f39ea15e:::143:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:ea992956:::144:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:48887b1c:::145:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:9f24a9dd:::146:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:987f100b:::147:head 2024-04-15T15:12:56.753 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d2dd3581:::148:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:7fed1808:::149:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c80b70e9:::150:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:85ed90f9:::151:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:36428b24:::152:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d044c34a:::153:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:7c18bf58:::154:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d1c21232:::155:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:a7a3c575:::156:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:87da0633:::157:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d5ac3822:::158:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:3f20522d:::159:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:6ca26563:::160:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:532ce135:::161:head 2024-04-15T15:12:56.754 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:c78863e6:::162:head 2024-04-15T15:13:08.487 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:46.330 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:08.489 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:46.332 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:08.510 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:46.353 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:08.534 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:46.325 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:08.538 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:46.328 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:08.556 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:46.346 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:08.560 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:46.404 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:08.562 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:46.405 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:08.582 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:46.425 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:18.382 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:56.224 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:18.382 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:56.225 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:18.401 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:14:56.244 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:18.440 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:56.230 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:18.441 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:56.232 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:18.450 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:56.293 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:18.451 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:56.294 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:18.458 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:14:56.249 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:18.467 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:14:56.310 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:28.413 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:06.256 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:28.418 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:06.258 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:28.439 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:06.282 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:28.474 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:06.264 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:28.476 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:06.266 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:28.478 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:06.321 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:28.479 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:06.323 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:28.494 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:06.284 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:28.495 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:06.338 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:38.413 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:16.255 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:38.458 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:16.249 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:38.462 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:16.253 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:38.466 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:16.306 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:38.484 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:16.275 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:38.487 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:16.330 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:38.512 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:16.355 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:38.514 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:16.357 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:38.537 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:16.380 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:48.483 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:26.325 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:48.484 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:26.327 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:48.505 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:26.347 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:48.532 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:26.322 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:48.533 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:26.324 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:48.536 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:26.379 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:48.537 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:26.381 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:48.552 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:26.343 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:48.558 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:26.401 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:58.504 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:36.346 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:58.505 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:36.348 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:58.520 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:36.363 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:58.551 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:36.341 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:58.552 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:36.342 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:58.555 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:36.398 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:58.557 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:36.400 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:58.564 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:36.355 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:13:58.570 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:36.413 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:03.691 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:41.533 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:03.767 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:41.609 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:03.786 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:41.577 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:03.787 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:41.630 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:03.791 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:41.634 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:03.811 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:41.602 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:03.816 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:41.659 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:03.827 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:41.618 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:03.833 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:41.676 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:06.475 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:7462ddf6:::163:head 2024-04-15T15:14:06.475 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:5d165639:::164:head 2024-04-15T15:14:06.475 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:f43765fc:::165:head 2024-04-15T15:14:06.475 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:b4c720e9:::166:head 2024-04-15T15:14:06.475 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:e694b040:::167:head 2024-04-15T15:14:06.475 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:afa38db2:::168:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:77ba9f53:::169:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:87495034:::170:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:7c96bf0e:::171:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:dbe346cc:::172:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:e943ec24:::173:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:f97a9c0c:::174:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:6f26e74d:::175:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:4f95e106:::176:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:0e6f2f8f:::177:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:05db05f1:::178:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:38a78d66:::179:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:d095610b:::180:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:a1a9d709:::181:head 2024-04-15T15:14:06.476 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:1e5d39db:::182:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:f7df4fb9:::183:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:03a7f161:::184:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:ba70721e:::185:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:28e5662d:::186:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:973d52de:::187:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:4303eb1c:::188:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:b990b48e:::189:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:29b8165b:::190:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:3547f197:::191:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:7e260936:::192:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:1abec7b1:::193:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:10fdda93:::194:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:15817eea:::195:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:770bab57:::196:head 2024-04-15T15:14:06.477 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:ed9e13e7:::197:head 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:71471a8f:::198:head 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: checking for 283:10fb1d02:::199:head 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (20956 ms) 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,0 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: first is 1713193993 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,0 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,0 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,1713193996,1713193997,0 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,1713193996,1713193997,0 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,1713193996,1713193997,0 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,1713193996,1713193997,1713193999,1713194000,0 2024-04-15T15:14:06.478 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,1713193996,1713193997,1713193999,1713194000,0 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,1713193996,1713193997,1713193999,1713194000,0 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,1713193996,1713193997,1713193999,1713194000,1713194002,1713194003,0 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,1713193996,1713193997,1713193999,1713194000,1713194002,1713194003,0 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193993,1713193996,1713193997,1713193999,1713194000,1713194002,1713194003,0 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713193997,1713193999,1713194000,1713194002,1713194003,1713194005,1713194006,0 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: first now 1713193997, trimmed 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (22253 ms) 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: foo0 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (16842 ms) 2024-04-15T15:14:06.479 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-04-15T15:14:18.692 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:56.534 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:18.693 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:56.536 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:18.726 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:15:56.568 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:18.751 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:56.594 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:18.753 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:56.596 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:18.756 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:56.546 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:18.758 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:56.548 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:18.784 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:15:56.626 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:18.792 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:15:56.582 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:33.770 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:11.613 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:33.772 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:11.615 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:33.791 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:11.634 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:33.822 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:11.612 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:33.823 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:11.666 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:33.823 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:11.613 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:33.824 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:11.667 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:33.842 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:11.632 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:33.843 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:11.687 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:38.765 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:16.607 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:38.766 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:16.609 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:38.786 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:16.629 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:38.814 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:16.657 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:38.818 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:16.661 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:38.818 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:16.609 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:38.822 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:16.613 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:38.838 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:16.681 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:38.841 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:16.631 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:48.701 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:26.491 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:48.702 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:26.545 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:48.703 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:26.494 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:48.707 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:26.549 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:48.725 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:26.515 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:48.728 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:26.571 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:48.764 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:26.607 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:48.766 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:26.609 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:48.793 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:26.636 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:58.999 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:36.841 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:59.003 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:36.846 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:59.035 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:36.877 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:59.063 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:36.906 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:59.065 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:36.908 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:59.082 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:36.872 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:59.095 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:36.939 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:59.102 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:36.893 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:14:59.138 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:36.928 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:03.788 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:41.631 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:03.790 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:41.633 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:03.804 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:41.646 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:03.833 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:41.623 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:03.834 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:41.624 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:03.845 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:41.689 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:03.846 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:41.637 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:03.847 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:41.690 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:03.867 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:41.710 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:18.839 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:56.682 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:18.844 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:56.686 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:18.860 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:16:56.703 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:18.892 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:56.682 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:18.893 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:56.684 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:18.896 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:56.739 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:18.897 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:56.740 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:18.908 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:16:56.699 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:18.913 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:16:56.756 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:23.936 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:01.779 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:23.940 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:01.783 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:23.951 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:01.794 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:23.987 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:01.777 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:23.990 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:01.780 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:23.991 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:01.834 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:23.992 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:01.836 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:24.002 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:01.791 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:24.008 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:01.851 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:38.960 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:16.803 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:39.020 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:16.863 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:39.043 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:16.885 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:39.069 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:16.859 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:39.069 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:16.912 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:39.071 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:16.914 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:39.072 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:16.863 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:39.092 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:16.934 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:39.092 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:16.883 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:54.083 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:31.926 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:54.085 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:31.928 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:54.106 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:31.948 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:54.132 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:31.975 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:54.135 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:31.978 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:54.140 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:31.930 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:54.145 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:31.935 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:54.163 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:32.006 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:54.177 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:31.967 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:59.109 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:36.952 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:59.113 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:36.955 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:59.115 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:36.906 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:59.128 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:36.971 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:59.131 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:36.922 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:59.158 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:36.948 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:59.182 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:37.025 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:59.186 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:37.029 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:15:59.207 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:37.050 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:09.201 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:47.043 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:09.204 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:47.047 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:09.227 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:47.069 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:09.259 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:47.102 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:09.264 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:47.107 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:09.264 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:47.055 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:09.266 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:47.056 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:09.285 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:47.076 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:09.293 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:47.137 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:19.075 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:56.918 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:19.079 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:56.922 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:19.092 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:17:56.934 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:19.127 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:56.917 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:19.128 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:56.919 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:19.129 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:56.973 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:19.131 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:56.974 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:19.140 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:17:56.931 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:19.143 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:17:56.986 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:29.098 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:06.941 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:29.102 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:06.945 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:29.115 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:06.957 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:29.148 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:06.938 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:29.149 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:06.940 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:29.153 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:06.996 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:29.154 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:06.997 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:29.162 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:06.953 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:29.165 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:07.009 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:39.161 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:17.003 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:39.163 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:17.006 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:39.186 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:17.028 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:39.216 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:17.007 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:39.218 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:17.008 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:39.218 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:17.062 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:39.222 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:17.066 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:39.236 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:17.026 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:39.241 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:17.084 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:44.154 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:21.997 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:44.158 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:22.001 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:44.173 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:22.016 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:44.205 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:21.995 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:44.208 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:21.999 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:44.211 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:22.054 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:44.214 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:22.058 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:44.219 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:22.009 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:44.226 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:22.068 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:59.345 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:37.188 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:59.351 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:37.194 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:59.383 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:37.226 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:59.409 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:37.252 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:59.411 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:37.254 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:59.413 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:37.203 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:59.421 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:37.211 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:59.450 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:37.293 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:16:59.452 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:37.243 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:04.366 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:42.208 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:04.368 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:42.211 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:04.384 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:42.227 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:04.414 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:42.205 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:04.417 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:42.208 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:04.419 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:42.262 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:04.421 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:42.264 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:04.432 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:42.222 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:04.438 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:42.281 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:05.219 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:43.009 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:05.220 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:43.010 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:05.232 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:43.023 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:05.349 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:43.191 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:05.350 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:43.193 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:05.355 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:43.197 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:05.356 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:43.199 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:05.366 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:43.209 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:05.375 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:43.217 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:14.369 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:52.212 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:14.373 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:52.216 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:14.389 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:18:52.232 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:14.420 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:52.210 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:14.421 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:52.212 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:14.428 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:52.271 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:14.431 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:52.274 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:14.433 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:18:52.224 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:14.460 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:18:52.303 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:23.244 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T15:17:23.221+0000 24e84640 -1 snap_mapper.add_oid found existing snaps mapped on 301:7781a2cf:test-rados-api-smithi038-41121-80::foo:2, removing 2024-04-15T15:17:23.247 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:17:23.239+0000 2e697640 -1 snap_mapper.add_oid found existing snaps mapped on 301:7781a2cf:test-rados-api-smithi038-41121-80::foo:2, removing 2024-04-15T15:17:24.395 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:02.238 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:24.413 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:02.242 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:24.413 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:02.253 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:24.447 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:02.237 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:24.448 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:02.238 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:24.459 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:02.249 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:24.461 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:02.304 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:24.463 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:02.306 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:24.475 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:02.318 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:29.650 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:07.492 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:29.654 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:07.497 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:29.670 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:07.512 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:29.703 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:07.493 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:29.704 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:07.494 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:29.707 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:07.550 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:29.712 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:07.555 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:29.717 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:07.508 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:29.726 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:07.569 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:44.486 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:22.328 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:44.538 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:22.380 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:44.566 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:22.408 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:44.587 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:22.377 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:44.589 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:22.432 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:44.590 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:22.381 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:44.591 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:22.434 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:44.619 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:22.409 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:44.631 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:22.474 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:45.468 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:23.258 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:45.469 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:23.260 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:45.480 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:23.270 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:45.529 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:23.372 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:45.535 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:23.373 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:45.535 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:23.374 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:45.535 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:23.375 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:45.542 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:23.385 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:45.546 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:23.389 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:17:58.392 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ProxyRead (21890 ms) 2024-04-15T15:17:58.393 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-04-15T15:17:58.393 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (24153 ms) 2024-04-15T15:17:58.393 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-04-15T15:17:58.393 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (4692 ms) 2024-04-15T15:17:58.393 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-04-15T15:17:58.393 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.393 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (5432 ms) 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (4327 ms) 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (5577 ms) 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (5524 ms) 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (39198 ms) 2024-04-15T15:17:58.394 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (18237 ms) 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4651 ms) 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (4519 ms) 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (26704 ms) 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (16995 ms) 2024-04-15T15:17:58.395 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (7021 ms) 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (5061 ms) 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: waiting for scrubs... 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: done waiting 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (26270 ms) 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (11385 ms) 2024-04-15T15:17:58.396 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-04-15T15:17:58.397 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.397 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (11114 ms) 2024-04-15T15:17:58.397 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-04-15T15:17:58.397 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:17:58.397 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (11058 ms) 2024-04-15T15:18:04.522 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:42.364 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:04.573 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:42.415 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:04.606 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:42.448 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:04.621 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:42.411 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:04.622 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:42.465 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:04.622 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:42.413 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:04.626 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:42.470 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:04.653 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:42.443 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:04.662 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:42.505 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:05.492 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:43.283 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:05.494 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:43.284 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:05.502 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:43.293 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:05.607 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:43.450 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:05.608 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:43.451 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:05.620 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:43.463 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:05.642 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:43.485 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:05.644 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:43.487 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:05.658 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:43.501 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:19.712 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:57.554 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:19.776 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:57.566 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:19.782 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:57.624 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:19.782 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:57.573 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:19.815 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:19:57.605 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:19.841 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:19:57.684 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:19.864 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:57.707 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:19.867 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:57.711 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:19.907 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:19:57.750 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:24.869 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:02.711 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:24.877 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:02.719 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:24.898 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:02.741 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:24.945 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:02.735 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:24.953 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:02.743 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:24.955 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:02.798 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:24.958 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:02.802 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:24.977 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:02.767 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:24.981 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:02.824 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:34.771 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:12.613 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:34.773 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:12.616 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:34.799 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:12.642 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:34.825 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:12.615 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:34.831 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:12.674 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:34.834 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:12.677 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:34.844 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:12.634 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:34.861 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:12.704 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:34.862 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:12.652 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:44.917 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:22.760 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:44.920 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:22.763 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:44.941 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:22.784 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:44.967 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:22.757 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:44.967 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:22.758 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:44.976 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:22.819 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:44.977 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:22.821 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:44.981 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:22.771 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:44.998 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:22.842 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:54.883 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:32.725 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:54.885 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:32.728 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:54.903 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:32.745 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:54.934 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:32.724 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:54.935 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:32.779 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:54.937 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:32.780 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:54.938 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:32.729 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:54.956 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:32.799 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:18:54.959 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:32.749 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:04.899 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:42.741 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:04.903 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:42.745 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:04.920 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:42.762 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:04.947 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:42.737 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:04.949 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:42.739 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:04.961 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:42.803 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:04.962 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:42.752 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:04.963 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:42.806 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:04.975 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:42.818 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:05.390 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:19:05.380+0000 20e7c640 -1 snap_mapper.add_oid found existing snaps mapped on 102:004c6d60:test-rados-api-smithi038-41121-97::foo:21, removing 2024-04-15T15:19:05.439 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:19:05.428+0000 27689640 -1 snap_mapper.add_oid found existing snaps mapped on 102:004c6d60:test-rados-api-smithi038-41121-97::foo:21, removing 2024-04-15T15:19:14.879 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:52.721 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:14.928 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:52.771 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:14.951 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:20:52.794 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:14.977 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:52.767 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:14.979 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:52.769 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:15.001 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:52.845 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:15.002 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:20:52.792 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:15.003 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:52.846 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:15.026 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:20:52.869 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:24.976 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:02.818 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:24.978 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:02.820 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:24.993 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:02.783 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:25.006 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:02.848 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:25.018 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:02.808 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:25.037 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:02.880 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:25.045 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:02.835 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:25.050 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:02.894 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:25.075 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:02.918 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:30.115 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:07.958 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:30.121 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:07.964 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:30.124 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:07.967 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:30.127 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:07.971 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:30.130 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:07.920 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:30.133 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:07.923 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:30.193 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:08.036 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:30.197 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:08.041 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:30.214 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:08.004 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:31.305 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:09.147 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:31.306 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:09.149 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:31.325 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:09.168 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:31.373 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:09.163 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:31.374 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:09.165 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:31.393 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:09.183 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:31.395 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:09.238 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:31.397 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:09.240 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:31.417 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:09.260 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:45.372 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:23.215 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:45.376 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:23.219 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:45.426 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:23.269 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:45.443 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:23.233 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:45.447 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:23.237 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:45.454 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:23.297 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:45.457 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:23.300 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:45.492 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:23.282 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:45.513 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:23.356 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:46.197 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:23.987 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:46.197 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:23.988 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:46.207 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:23.997 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:46.261 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:24.104 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:46.262 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:24.105 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:46.277 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:24.119 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:46.331 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:24.174 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:46.332 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:24.175 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:19:46.342 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:24.185 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:00.460 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:38.302 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:00.511 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:38.353 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:00.541 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:38.383 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:00.567 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:38.357 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:00.570 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:38.360 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:00.582 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:38.425 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:00.599 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:38.443 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:00.605 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:38.396 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:00.641 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:38.484 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:05.400 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:43.242 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:05.404 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:43.247 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:05.426 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:43.268 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:05.449 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:43.239 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:05.450 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:43.240 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:05.463 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:43.254 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:05.477 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:43.320 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:05.478 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:43.322 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:05.493 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:43.336 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:15.499 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:53.342 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:15.558 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:53.400 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:15.588 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:21:53.430 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:15.628 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:53.418 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:15.628 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:53.471 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:15.632 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:53.475 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:15.635 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:53.425 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:15.670 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:21:53.513 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:15.670 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:21:53.460 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:30.682 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:08.525 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:30.686 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:08.528 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:30.713 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:08.556 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:30.734 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:08.524 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:30.735 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:08.525 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:30.738 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:08.581 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:30.740 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:08.583 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:30.761 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:08.551 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:30.768 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:08.611 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:45.737 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:23.580 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:45.742 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:23.584 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:45.790 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:23.632 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:45.809 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:23.599 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:45.810 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:23.653 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:45.810 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:23.601 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:45.815 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:23.658 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:45.853 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:23.644 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:45.860 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:23.703 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:50.724 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:28.566 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:50.727 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:28.570 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:50.742 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:28.584 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:50.772 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:28.562 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:50.773 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:28.563 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:50.776 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:28.619 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:50.777 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:28.620 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:50.786 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:28.576 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:20:50.793 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:28.636 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:00.694 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:38.536 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:00.695 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:38.538 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:00.713 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:38.555 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:00.747 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:38.590 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:00.749 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:38.591 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:00.749 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:38.538 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:00.750 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:38.540 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:00.766 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:38.556 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:00.766 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:38.609 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:10.817 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:48.660 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:10.820 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:48.663 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:10.837 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:48.680 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:10.873 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:48.716 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:10.873 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:48.664 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:10.875 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:48.718 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:10.891 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:48.734 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:10.898 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:48.688 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:10.917 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:48.708 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:15.921 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:53.763 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:15.925 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:53.767 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:15.940 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:22:53.782 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:15.976 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:53.766 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:15.980 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:53.770 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:15.994 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:53.837 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:15.994 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:22:53.784 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:15.995 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:53.838 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:16.011 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:22:53.854 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:31.037 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:08.879 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:31.040 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:08.883 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:31.085 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:08.928 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:31.098 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:08.888 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:31.101 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:08.892 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:31.113 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:08.956 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:31.118 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:08.961 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:31.130 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:08.920 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:31.155 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:08.998 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:36.269 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:14.111 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:36.276 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:14.119 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:36.299 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:14.142 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:36.326 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:14.116 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:36.327 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:14.118 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:36.345 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:14.135 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:36.347 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:14.190 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:36.348 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:14.191 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:36.367 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:14.210 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:45.911 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:23.754 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:45.915 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:23.758 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:45.935 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:23.778 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:45.962 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:23.753 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:45.965 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:23.754 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:45.967 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:23.810 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:45.968 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:23.811 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:45.982 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:23.772 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:45.988 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:23.831 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:51.123 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:28.966 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:51.126 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:28.969 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:51.167 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:29.010 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:51.169 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:28.960 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:51.171 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:28.961 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:51.177 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:29.020 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:51.179 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:29.022 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:51.185 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:28.976 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:21:51.196 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:29.040 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:00.959 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:38.801 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:01.008 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:38.851 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:01.009 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:38.799 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:01.010 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:38.800 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:01.030 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:38.873 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:01.031 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:38.821 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:01.101 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:38.944 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:01.103 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:38.946 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:01.123 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:38.966 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:03.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-04-15T15:22:03.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:22:03.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (11301 ms) 2024-04-15T15:22:03.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-04-15T15:22:03.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:22:03.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (7609 ms) 2024-04-15T15:22:03.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-04-15T15:22:03.057 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (6762 ms) 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (27256 ms) 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (15697 ms) 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (15210 ms) 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: 00000010 69 73 |is| 2024-04-15T15:22:03.058 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: 00000012 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (13566 ms) 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: require_osd_release = squid 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (7504 ms) 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (973017 ms total) 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1442 ms) 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (10903 ms) 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-04-15T15:22:03.059 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (20762 ms) 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (12 ms) 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (33119 ms total) 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (8397 ms) 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8840 ms) 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: waiting for scrub... 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: done waiting 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (25813 ms) 2024-04-15T15:22:03.060 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-04-15T15:22:03.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (11945 ms) 2024-04-15T15:22:03.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-04-15T15:22:03.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (9891 ms) 2024-04-15T15:22:03.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-04-15T15:22:03.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (9080 ms) 2024-04-15T15:22:03.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-04-15T15:22:03.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (11565 ms) 2024-04-15T15:22:03.061 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-04-15T15:22:11.124 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:48.966 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:11.126 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:48.969 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:11.147 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:48.989 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:11.172 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:48.962 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:11.174 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:48.965 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:11.189 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:49.032 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:11.192 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:49.034 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:11.193 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:48.984 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:11.211 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:49.054 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:16.141 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:53.983 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:16.144 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:53.987 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:16.157 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:23:53.999 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:16.206 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:53.995 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:16.206 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:53.996 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:16.206 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:54.048 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:16.207 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:54.050 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:16.217 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:23:54.007 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:16.221 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:23:54.065 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.108 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:08.950 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.112 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:08.955 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.141 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:08.984 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.159 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:08.949 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.162 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:08.952 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.165 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:09.008 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.168 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:09.011 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.188 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:08.979 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.200 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:09.043 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.953 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:09.744 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.954 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:09.745 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:31.963 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:09.753 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:32.076 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:09.919 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:32.077 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:09.920 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:32.090 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:09.933 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:32.103 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:09.946 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:32.104 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:09.947 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:32.114 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:09.957 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:46.330 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:24.172 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:46.334 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:24.177 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:46.373 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:24.215 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:46.385 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:24.176 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:46.390 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:24.180 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:46.403 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:24.246 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:46.404 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:24.248 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:46.422 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:24.212 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:46.435 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:24.279 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:51.448 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:29.291 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:51.453 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:29.296 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:51.473 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:29.316 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:51.508 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:29.299 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:51.515 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:29.306 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:51.526 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:29.369 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:51.529 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:29.372 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:51.535 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:29.326 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:22:51.551 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:29.394 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:01.317 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:39.160 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:01.319 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:39.162 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:01.340 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:39.183 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:01.364 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:39.155 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:01.365 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:39.156 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:01.370 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:39.213 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:01.371 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:39.215 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:01.385 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:39.175 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:01.392 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:39.235 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:11.508 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:49.350 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:11.512 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:49.355 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:11.516 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:49.306 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:11.520 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:49.311 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:11.550 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:49.392 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:11.554 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:49.344 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:11.576 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:49.419 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:11.586 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:49.430 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:11.623 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:49.466 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:16.374 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:54.217 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:16.379 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:54.222 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:16.393 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:24:54.236 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:16.423 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:54.214 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:16.425 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:54.215 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:16.428 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:54.272 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:16.430 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:54.273 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:16.438 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:24:54.229 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:16.444 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:24:54.287 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:31.542 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:09.384 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:31.545 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:09.388 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:31.564 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:09.406 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:31.600 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:09.390 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:31.601 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:09.392 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:31.617 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:09.460 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:31.620 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:09.463 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:31.621 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:09.411 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:31.639 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:09.482 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:36.401 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:14.244 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:36.455 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:14.298 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:36.469 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:14.311 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:36.504 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:14.295 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:36.505 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:14.296 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:36.506 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:14.349 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:36.507 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:14.350 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:36.519 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:14.309 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:36.520 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:14.363 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:42.062 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:19.904 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:42.065 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:19.908 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:42.073 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:19.863 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:42.074 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:19.917 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:42.075 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:19.866 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:42.076 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:19.919 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:42.138 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:19.981 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:42.143 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:19.934 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:42.149 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:19.993 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:51.603 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:29.446 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:51.607 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:29.450 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:51.630 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:29.473 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:51.654 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:29.497 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:51.655 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:29.445 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:51.657 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:29.501 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:51.658 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:29.449 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:51.681 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:29.524 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:23:51.682 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:29.473 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:11.716 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:49.558 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:11.720 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:49.563 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:11.746 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:49.588 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:11.769 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:49.559 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:11.770 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:49.560 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:11.789 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:49.632 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:11.791 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:49.634 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:11.794 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:49.585 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:11.814 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:49.657 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:16.713 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:54.556 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:16.718 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:54.561 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:16.738 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:25:54.581 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:16.771 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:54.562 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:16.774 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:54.564 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:16.782 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:54.626 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:16.786 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:54.629 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:16.793 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:25:54.583 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:16.804 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:25:54.647 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:26.657 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:04.499 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:26.659 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:04.502 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:26.685 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:04.527 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:26.703 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:04.494 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:26.704 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:04.495 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:26.717 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:04.560 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:26.718 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:04.561 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:26.719 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:04.510 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:26.734 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:04.577 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:36.719 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:14.562 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:36.781 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:14.572 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:36.782 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:14.573 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:36.787 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:14.629 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:36.810 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:14.601 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:36.812 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:14.655 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:36.854 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:14.697 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:36.855 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:14.699 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:36.877 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:14.720 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:41.765 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:19.555 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:41.784 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:19.627 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:41.788 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:19.631 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:41.800 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:19.590 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:41.806 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:19.648 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:41.816 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:19.606 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:41.858 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:19.701 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:41.861 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:19.704 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:41.876 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:19.720 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:53.945 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (9851 ms) 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (14549 ms) 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (9868 ms) 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (14188 ms) 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (8838 ms) 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-04-15T15:24:53.946 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (9090 ms) 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: hmm, no HitSet yet 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: ok, hit_set contains 333:602f83fe:::foo:head 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9752 ms) 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,0 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: first is 1713194597 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,0 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,0 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,1713194600,1713194601,0 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,1713194600,1713194601,0 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,1713194600,1713194601,0 2024-04-15T15:24:53.947 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,1713194600,1713194601,1713194603,1713194604,0 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,1713194600,1713194601,1713194603,1713194604,0 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,1713194600,1713194601,1713194603,1713194604,0 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,1713194600,1713194601,1713194603,1713194604,1713194606,1713194607,0 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,1713194600,1713194601,1713194603,1713194604,1713194606,1713194607,0 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194597,1713194600,1713194601,1713194603,1713194604,1713194606,1713194607,0 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: got ls 1713194601,1713194603,1713194604,1713194606,1713194607,1713194609,1713194610,0 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: first now 1713194601, trimmed 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (22130 ms) 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: foo0 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-04-15T15:24:53.948 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (15513 ms) 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (19852 ms) 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (25282 ms) 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (6469 ms) 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (4641 ms) 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (4339 ms) 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3201 ms) 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (263094 ms total) 2024-04-15T15:24:53.949 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: 2024-04-15T15:24:53.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-04-15T15:24:53.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (1415449 ms total) 2024-04-15T15:24:53.950 INFO:tasks.workunit.client.0.smithi038.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40837 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40837 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41019 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41019 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41476 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41476 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41225 2024-04-15T15:24:53.955 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41225 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41134 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41134 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40920 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40920 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41158 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41158 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41671 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41671 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41706 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41706 2024-04-15T15:24:53.956 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40942 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40942 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41572 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41572 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41383 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41383 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40812 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40812 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40874 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40874 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.957 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41412 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41412 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40802 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40802 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40824 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40824 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41853 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41853 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41041 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41041 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.958 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41898 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41898 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41144 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41144 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41640 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41640 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41948 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41948 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41097 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41097 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41448 2024-04-15T15:24:53.959 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41448 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41785 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41785 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41612 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41612 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41876 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41876 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41323 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41323 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40999 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40999 2024-04-15T15:24:53.960 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41914 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41914 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41240 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41240 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40795 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40795 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40854 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40854 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41174 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41174 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.961 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=40895 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 40895 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41265 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41265 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41292 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41292 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41757 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41757 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ for t in "${!pids[@]}" 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ pid=41976 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ wait 41976 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ exit 0 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ cleanup 2024-04-15T15:24:53.962 INFO:tasks.workunit.client.0.smithi038.stderr:+ pkill -P 40789 2024-04-15T15:24:53.966 INFO:tasks.workunit.client.0.smithi038.stderr:+ true 2024-04-15T15:24:53.966 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-15T15:24:53.967 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-15T15:24:53.997 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2024-04-15T15:24:53.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-15T15:24:54.338 DEBUG:teuthology.parallel:result is None 2024-04-15T15:24:54.338 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-15T15:24:54.367 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-15T15:24:54.368 DEBUG:teuthology.orchestra.run.smithi038:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-15T15:24:54.439 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-15T15:24:54.439 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-15T15:24:54.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T15:24:54.452 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:24:54.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.580+0000 7fae51cc8640 10 monclient: get_monmap_and_config 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.580+0000 7fae51cc8640 10 monclient: build_initial_monmap 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.580+0000 7fae51cc8640 10 monclient: monmap: 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:24:54.581509+0000 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:24:54.581509+0000 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:24:54.583 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:54.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.581+0000 7fae51cc8640 1 Processor -- start 2024-04-15T15:24:54.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.581+0000 7fae51cc8640 1 -- start start 2024-04-15T15:24:54.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.581+0000 7fae51cc8640 10 monclient: init 2024-04-15T15:24:54.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:54.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T15:24:54.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 10 monclient(hunting): picked mon.noname-b con 0x7fae4c0aaf60 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:54.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 10 monclient(hunting): picked mon.noname-a con 0x7fae4c0b0ae0 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:54.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 10 monclient(hunting): picked mon.noname-c con 0x7fae4c149060 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c0ad730 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c0b1300 con 0x7fae4c149060 2024-04-15T15:24:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c0732e0 con 0x7fae4c0aaf60 2024-04-15T15:24:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae51cc8640 10 monclient(hunting): authenticate will time out at 2954.852640s 2024-04-15T15:24:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae4b7fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fae4c0aaf60 0x7fae4c142cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:55950/0 (socket says 172.21.15.38:55950) 2024-04-15T15:24:54.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.582+0000 7fae4b7fe640 1 -- 172.21.15.38:0/4048596399 learned_addr learned my addr 172.21.15.38:0/4048596399 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:54.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107881907 0 0) 0x7fae4c0b1300 con 0x7fae4c149060 2024-04-15T15:24:54.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:54.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:54.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:54.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 10 monclient(hunting): my global_id is 32251 2024-04-15T15:24:54.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae38003440 con 0x7fae4c149060 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1091590275 0 0) 0x7fae4c0732e0 con 0x7fae4c0aaf60 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 10 monclient(hunting): my global_id is 81002 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.585+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c0b1300 con 0x7fae4c0aaf60 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.586+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474614746 0 0) 0x7fae4c0ad730 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.586+0000 7fae4a7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.586+0000 7fae4a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.586+0000 7fae4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.586+0000 7fae4a7fc640 10 monclient(hunting): my global_id is 33537 2024-04-15T15:24:54.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.586+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c0732e0 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2071185393 0 0) 0x7fae38003440 con 0x7fae4c149060 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 >> v1:172.21.15.38:6790/0 conn(0x7fae4c0aaf60 legacy=0x7fae4c142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 >> v1:172.21.15.38:6789/0 conn(0x7fae4c0b0ae0 legacy=0x7fae4c13fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 10 monclient: _finish_hunting 0 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 1 monclient: found mon.noname-c 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c0ac4a0 con 0x7fae4c149060 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 10 monclient: _finish_auth 0 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 10 monclient: _check_auth_tickets 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fae44001990 con 0x7fae4c149060 2024-04-15T15:24:54.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae4a7fc640 10 monclient: dump: 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae51cc8640 5 monclient: authenticate success, global_id 32251 2024-04-15T15:24:54.591 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.588+0000 7fae51cc8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.590+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae44001bf0 con 0x7fae4c149060 2024-04-15T15:24:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.590+0000 7fae4a7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.590+0000 7fae4a7fc640 1 -- 172.21.15.38:0/4048596399 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fae44001fc0 con 0x7fae4c149060 2024-04-15T15:24:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.590+0000 7fae4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:54.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.590+0000 7fae4a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.590+0000 7fae4a7fc640 10 monclient: dump: 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.590+0000 7fae51cc8640 10 monclient: get_monmap_and_config success 2024-04-15T15:24:54.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.590+0000 7fae51cc8640 4 set_mon_vals no callback set 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.591+0000 7fae51cc8640 10 monclient: shutdown 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.591+0000 7fae51cc8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.591+0000 7fae51cc8640 1 -- 172.21.15.38:0/4048596399 >> v1:172.21.15.164:6789/0 conn(0x7fae4c149060 legacy=0x7fae4c14b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.591+0000 7fae51cc8640 1 -- 172.21.15.38:0/4048596399 shutdown_connections 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.591+0000 7fae51cc8640 1 -- 172.21.15.38:0/4048596399 >> 172.21.15.38:0/4048596399 conn(0x7fae4c068140 msgr2=0x7fae4c0b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.591+0000 7fae51cc8640 1 -- 172.21.15.38:0/4048596399 shutdown_connections 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.591+0000 7fae51cc8640 1 -- 172.21.15.38:0/4048596399 wait complete. 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.592+0000 7fae51cc8640 10 monclient: build_initial_monmap 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.592+0000 7fae51cc8640 10 monclient: monmap: 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:54.595 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.592+0000 7fae51cc8640 1 librados: starting msgr at 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.592+0000 7fae51cc8640 1 librados: starting objecter 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.592+0000 7fae51cc8640 1 Processor -- start 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.592+0000 7fae51cc8640 1 -- start start 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.592+0000 7fae51cc8640 1 librados: setting wanted keys 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.592+0000 7fae51cc8640 1 librados: calling monclient init 2024-04-15T15:24:54.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.592+0000 7fae51cc8640 10 monclient: init 2024-04-15T15:24:54.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 10 monclient(hunting): picked mon.noname-c con 0x7fae4c0aaf60 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 10 monclient(hunting): picked mon.noname-b con 0x7fae4c0b0ae0 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 10 monclient(hunting): picked mon.noname-a con 0x7fae4c149060 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c134760 con 0x7fae4c149060 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c13f610 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c1349e0 con 0x7fae4c0aaf60 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae51cc8640 10 monclient(hunting): authenticate will time out at 2954.863604s 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae4b7fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fae4c0aaf60 0x7fae4c1d87a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:55958/0 (socket says 172.21.15.38:55958) 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae4bfff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fae4c149060 0x7fae4c134050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44094/0 (socket says 172.21.15.38:44094) 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae4b7fe640 1 -- 172.21.15.38:0/2560633207 learned_addr learned my addr 172.21.15.38:0/2560633207 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.593+0000 7fae43fff640 10 client.?.objecter ms_handle_connect 0x7fae4c0aaf60 2024-04-15T15:24:54.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.594+0000 7fae43fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.594+0000 7fae43fff640 10 client.?.objecter ms_handle_connect 0x7fae4c149060 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.594+0000 7fae43fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.594+0000 7fae43fff640 10 client.?.objecter ms_handle_connect 0x7fae4c0b0ae0 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.594+0000 7fae43fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.595+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198419529 0 0) 0x7fae4c13f610 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.595+0000 7fae43fff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.595+0000 7fae43fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.595+0000 7fae43fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.595+0000 7fae43fff640 10 monclient(hunting): my global_id is 32254 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae2c004eb0 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244463065 0 0) 0x7fae4c1349e0 con 0x7fae4c0aaf60 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:54.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 10 monclient(hunting): my global_id is 81005 2024-04-15T15:24:54.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c13f610 con 0x7fae4c0aaf60 2024-04-15T15:24:54.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3389385533 0 0) 0x7fae4c134760 con 0x7fae4c149060 2024-04-15T15:24:54.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:54.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:54.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:54.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 10 monclient(hunting): my global_id is 33540 2024-04-15T15:24:54.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.596+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c1349e0 con 0x7fae4c149060 2024-04-15T15:24:54.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.600+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1081632533 0 0) 0x7fae2c004eb0 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.600+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae4c134760 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.600+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fae3c0018b0 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.600+0000 7fae43fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.600+0000 7fae43fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.600+0000 7fae43fff640 10 monclient(hunting): dump: 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:54.602 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:54.603 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:54.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.600+0000 7fae43fff640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:24:54.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1328860863 0 0) 0x7fae4c13f610 con 0x7fae4c0aaf60 2024-04-15T15:24:54.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae2c004eb0 con 0x7fae4c0aaf60 2024-04-15T15:24:54.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fae340018f0 con 0x7fae4c0aaf60 2024-04-15T15:24:54.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:54.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:24:54.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 10 monclient(hunting): dump: 2024-04-15T15:24:54.605 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:54.605 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3866396097 0 0) 0x7fae4c1349e0 con 0x7fae4c149060 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae4c13f610 con 0x7fae4c149060 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2817847087 0 0) 0x7fae4c134760 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 >> v1:172.21.15.38:6790/0 conn(0x7fae4c0aaf60 legacy=0x7fae4c1d87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 >> v1:172.21.15.38:6789/0 conn(0x7fae4c149060 legacy=0x7fae4c134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 10 monclient: _finish_hunting 0 2024-04-15T15:24:54.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 monclient: found mon.b 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c13dca0 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 10 monclient: _finish_auth 0 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 10 monclient: _check_auth_tickets 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae43fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae51cc8640 5 monclient: authenticate success, global_id 32254 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae51cc8640 10 monclient: _renew_subs 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae51cc8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae4c13e220 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae51cc8640 10 client.32254.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae51cc8640 10 monclient: _renew_subs 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae51cc8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fae4c13d810 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.603+0000 7fae51cc8640 1 librados: init done 2024-04-15T15:24:54.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.604+0000 7fae51cc8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:54.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.604+0000 7fae51cc8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:54.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.604+0000 7fae51cc8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:54.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.604+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae4c077050 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.619+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae3c003610 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.619+0000 7fae43fff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.619+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fae3c003960 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.619+0000 7fae43fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.619+0000 7fae43fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.619+0000 7fae43fff640 10 monclient: dump: 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.621 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:54.622 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:54.622 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.619+0000 7fae497fa640 4 set_mon_vals no callback set 2024-04-15T15:24:54.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.621+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fae3c019e90 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.621+0000 7fae4b7fe640 10 monclient: get_auth_request con 0x7fae2c06f100 auth_method 0 2024-04-15T15:24:54.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.621+0000 7fae43fff640 10 client.32254.objecter ms_handle_connect 0x7fae2c06f100 2024-04-15T15:24:54.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.622+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(995..995 src has 501..995) ==== 5226+0+0 (unknown 354831944 0 0) 0x7fae3c052260 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.623 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.622+0000 7fae43fff640 10 client.32254.objecter ms_dispatch 0x7fae4c000b90 osd_map(995..995 src has 501..995) 2024-04-15T15:24:54.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.622+0000 7fae43fff640 3 client.32254.objecter handle_osd_map got epochs [995,995] > 0 2024-04-15T15:24:54.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.622+0000 7fae43fff640 3 client.32254.objecter handle_osd_map decoding full epoch 995 2024-04-15T15:24:54.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.622+0000 7fae43fff640 20 client.32254.objecter dump_active .. 0 homeless 2024-04-15T15:24:54.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.856+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fae3c054660 con 0x7fae4c0b0ae0 2024-04-15T15:24:54.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.856+0000 7fae43fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:54.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:54.856+0000 7fae43fff640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:24:55.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.050+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae4c1404a0 con 0x7fae2c06f100 2024-04-15T15:24:55.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.053+0000 7fae43fff640 1 -- 172.21.15.38:0/2560633207 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+116281 (unknown 2965378022 0 350777269) 0x7fae4c1404a0 con 0x7fae2c06f100 2024-04-15T15:24:55.060 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T15:24:55.060 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-15T15:24:55.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.055+0000 7fae51cc8640 10 librados: watch_flush enter 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.055+0000 7fae51cc8640 10 librados: watch_flush exit 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.055+0000 7fae51cc8640 20 client.32254.objecter shutdown clearing up homeless session... 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.055+0000 7fae51cc8640 10 client.32254.objecter successfully canceled tick 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.056+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 >> v1:172.21.15.38:6800/1608957829 conn(0x7fae2c06f100 legacy=0x7fae2c0715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.056+0000 7fae51cc8640 10 monclient: shutdown 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.056+0000 7fae51cc8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.056+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 >> v1:172.21.15.164:6789/0 conn(0x7fae4c0b0ae0 legacy=0x7fae4c133940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.056+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 shutdown_connections 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.056+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 >> 172.21.15.38:0/2560633207 conn(0x7fae4c068140 msgr2=0x7fae4c13fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.056+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 shutdown_connections 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.056+0000 7fae51cc8640 1 -- 172.21.15.38:0/2560633207 wait complete. 2024-04-15T15:24:55.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.056+0000 7fae51cc8640 1 librados: shutdown 2024-04-15T15:24:55.068 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1757,"stamp":"2024-04-15T15:24:53.871079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":609876,"kb_used_data":59152,"kb_used_omap":12,"kb_used_meta":550579,"kb_avail":754364844,"statfs":{"total":773094113280,"available":772469600256,"internally_reserved":0,"allocated":60571648,"data_stored":28724887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":563793457},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":552,"apply_latency_ms":552,"commit_latency_ns":552000000,"apply_latency_ns":552000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000299,"num_objects":-44,"num_object_clones":-1,"num_object_copies":-132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-44,"num_whiteouts":0,"num_read":-29,"num_read_kb":-10,"num_write":-69,"num_write_kb":-3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.246328"},"pg_stats":[{"pgid":"16.0","version":"0'0","reported_seq":1886,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.761965+0000","last_change":"2024-04-15T15:01:50.438639+0000","last_active":"2024-04-15T15:24:52.761965+0000","last_peered":"2024-04-15T15:24:52.761965+0000","last_clean":"2024-04-15T15:24:52.761965+0000","last_became_active":"2024-04-15T15:01:50.426257+0000","last_became_peered":"2024-04-15T15:01:50.426257+0000","last_unstale":"2024-04-15T15:24:52.761965+0000","last_undegraded":"2024-04-15T15:24:52.761965+0000","last_fullsized":"2024-04-15T15:24:52.761965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:32:49.021840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1","version":"50'7","reported_seq":1907,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.749423+0000","last_change":"2024-04-15T15:01:58.061052+0000","last_active":"2024-04-15T15:24:52.749423+0000","last_peered":"2024-04-15T15:24:52.749423+0000","last_clean":"2024-04-15T15:24:52.749423+0000","last_became_active":"2024-04-15T15:01:58.055451+0000","last_became_peered":"2024-04-15T15:01:58.055451+0000","last_unstale":"2024-04-15T15:24:52.749423+0000","last_undegraded":"2024-04-15T15:24:52.749423+0000","last_fullsized":"2024-04-15T15:24:52.749423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:21:09.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1847,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.718058+0000","last_change":"2024-04-15T15:01:50.838864+0000","last_active":"2024-04-15T15:24:49.718058+0000","last_peered":"2024-04-15T15:24:49.718058+0000","last_clean":"2024-04-15T15:24:49.718058+0000","last_became_active":"2024-04-15T15:01:50.831566+0000","last_became_peered":"2024-04-15T15:01:50.831566+0000","last_unstale":"2024-04-15T15:24:49.718058+0000","last_undegraded":"2024-04-15T15:24:49.718058+0000","last_fullsized":"2024-04-15T15:24:49.718058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:16:57.027776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1874,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.058944+0000","last_change":"2024-04-15T15:01:37.314165+0000","last_active":"2024-04-15T15:24:51.058944+0000","last_peered":"2024-04-15T15:24:51.058944+0000","last_clean":"2024-04-15T15:24:51.058944+0000","last_became_active":"2024-04-15T15:01:37.307442+0000","last_became_peered":"2024-04-15T15:01:37.307442+0000","last_unstale":"2024-04-15T15:24:51.058944+0000","last_undegraded":"2024-04-15T15:24:51.058944+0000","last_fullsized":"2024-04-15T15:24:51.058944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:53:10.058304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.895591+0000","last_change":"2024-04-15T15:01:59.509650+0000","last_active":"2024-04-15T15:24:50.895591+0000","last_peered":"2024-04-15T15:24:50.895591+0000","last_clean":"2024-04-15T15:24:50.895591+0000","last_became_active":"2024-04-15T15:01:59.386200+0000","last_became_peered":"2024-04-15T15:01:59.386200+0000","last_unstale":"2024-04-15T15:24:50.895591+0000","last_undegraded":"2024-04-15T15:24:50.895591+0000","last_fullsized":"2024-04-15T15:24:50.895591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:48:58.277123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.830171+0000","last_change":"2024-04-15T15:01:59.531768+0000","last_active":"2024-04-15T15:24:50.830171+0000","last_peered":"2024-04-15T15:24:50.830171+0000","last_clean":"2024-04-15T15:24:50.830171+0000","last_became_active":"2024-04-15T15:01:59.475519+0000","last_became_peered":"2024-04-15T15:01:59.475519+0000","last_unstale":"2024-04-15T15:24:50.830171+0000","last_undegraded":"2024-04-15T15:24:50.830171+0000","last_fullsized":"2024-04-15T15:24:50.830171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:03:14.693476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1864,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.933158+0000","last_change":"2024-04-15T15:02:06.546089+0000","last_active":"2024-04-15T15:24:49.933158+0000","last_peered":"2024-04-15T15:24:49.933158+0000","last_clean":"2024-04-15T15:24:49.933158+0000","last_became_active":"2024-04-15T15:02:06.539897+0000","last_became_peered":"2024-04-15T15:02:06.539897+0000","last_unstale":"2024-04-15T15:24:49.933158+0000","last_undegraded":"2024-04-15T15:24:49.933158+0000","last_fullsized":"2024-04-15T15:24:49.933158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:37:56.830252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1845,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.744451+0000","last_change":"2024-04-15T15:01:56.856132+0000","last_active":"2024-04-15T15:24:49.744451+0000","last_peered":"2024-04-15T15:24:49.744451+0000","last_clean":"2024-04-15T15:24:49.744451+0000","last_became_active":"2024-04-15T15:01:56.846541+0000","last_became_peered":"2024-04-15T15:01:56.846541+0000","last_unstale":"2024-04-15T15:24:49.744451+0000","last_undegraded":"2024-04-15T15:24:49.744451+0000","last_fullsized":"2024-04-15T15:24:49.744451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:11:40.534644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1895,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.033567+0000","last_change":"2024-04-15T15:01:31.031846+0000","last_active":"2024-04-15T15:24:51.033567+0000","last_peered":"2024-04-15T15:24:51.033567+0000","last_clean":"2024-04-15T15:24:51.033567+0000","last_became_active":"2024-04-15T15:01:31.025154+0000","last_became_peered":"2024-04-15T15:01:31.025154+0000","last_unstale":"2024-04-15T15:24:51.033567+0000","last_undegraded":"2024-04-15T15:24:51.033567+0000","last_fullsized":"2024-04-15T15:24:51.033567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:58.719678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1872,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.019777+0000","last_change":"2024-04-15T15:01:47.686569+0000","last_active":"2024-04-15T15:24:51.019777+0000","last_peered":"2024-04-15T15:24:51.019777+0000","last_clean":"2024-04-15T15:24:51.019777+0000","last_became_active":"2024-04-15T15:01:47.652436+0000","last_became_peered":"2024-04-15T15:01:47.652436+0000","last_unstale":"2024-04-15T15:24:51.019777+0000","last_undegraded":"2024-04-15T15:24:51.019777+0000","last_fullsized":"2024-04-15T15:24:51.019777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:56:25.406881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1892,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.758941+0000","last_change":"2024-04-15T15:01:58.212389+0000","last_active":"2024-04-15T15:24:52.758941+0000","last_peered":"2024-04-15T15:24:52.758941+0000","last_clean":"2024-04-15T15:24:52.758941+0000","last_became_active":"2024-04-15T15:01:58.198421+0000","last_became_peered":"2024-04-15T15:01:58.198421+0000","last_unstale":"2024-04-15T15:24:52.758941+0000","last_undegraded":"2024-04-15T15:24:52.758941+0000","last_fullsized":"2024-04-15T15:24:52.758941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:07:05.883431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1878,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.675075+0000","last_change":"2024-04-15T15:01:58.537678+0000","last_active":"2024-04-15T15:24:49.675075+0000","last_peered":"2024-04-15T15:24:49.675075+0000","last_clean":"2024-04-15T15:24:49.675075+0000","last_became_active":"2024-04-15T15:01:58.520219+0000","last_became_peered":"2024-04-15T15:01:58.520219+0000","last_unstale":"2024-04-15T15:24:49.675075+0000","last_undegraded":"2024-04-15T15:24:49.675075+0000","last_fullsized":"2024-04-15T15:24:49.675075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:14:29.432422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1869,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.880251+0000","last_change":"2024-04-15T15:01:48.968180+0000","last_active":"2024-04-15T15:24:49.880251+0000","last_peered":"2024-04-15T15:24:49.880251+0000","last_clean":"2024-04-15T15:24:49.880251+0000","last_became_active":"2024-04-15T15:01:48.927422+0000","last_became_peered":"2024-04-15T15:01:48.927422+0000","last_unstale":"2024-04-15T15:24:49.880251+0000","last_undegraded":"2024-04-15T15:24:49.880251+0000","last_fullsized":"2024-04-15T15:24:49.880251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:03:54.276935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":2024,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.724026+0000","last_change":"2024-04-15T14:59:45.003334+0000","last_active":"2024-04-15T15:24:49.724026+0000","last_peered":"2024-04-15T15:24:49.724026+0000","last_clean":"2024-04-15T15:24:49.724026+0000","last_became_active":"2024-04-15T14:59:44.414489+0000","last_became_peered":"2024-04-15T14:59:44.414489+0000","last_unstale":"2024-04-15T15:24:49.724026+0000","last_undegraded":"2024-04-15T15:24:49.724026+0000","last_fullsized":"2024-04-15T15:24:49.724026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_clean_scrub_stamp":"2024-04-15T14:59:36.273099+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:03.807751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1888,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.061620+0000","last_change":"2024-04-15T14:59:53.285621+0000","last_active":"2024-04-15T15:24:51.061620+0000","last_peered":"2024-04-15T15:24:51.061620+0000","last_clean":"2024-04-15T15:24:51.061620+0000","last_became_active":"2024-04-15T14:59:53.276305+0000","last_became_peered":"2024-04-15T14:59:53.276305+0000","last_unstale":"2024-04-15T15:24:51.061620+0000","last_undegraded":"2024-04-15T15:24:51.061620+0000","last_fullsized":"2024-04-15T15:24:51.061620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:22:32.578057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1880,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.714070+0000","last_change":"2024-04-15T15:01:50.074053+0000","last_active":"2024-04-15T15:24:49.714070+0000","last_peered":"2024-04-15T15:24:49.714070+0000","last_clean":"2024-04-15T15:24:49.714070+0000","last_became_active":"2024-04-15T15:01:50.052081+0000","last_became_peered":"2024-04-15T15:01:50.052081+0000","last_unstale":"2024-04-15T15:24:49.714070+0000","last_undegraded":"2024-04-15T15:24:49.714070+0000","last_fullsized":"2024-04-15T15:24:49.714070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:30:25.217264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1889,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.068419+0000","last_change":"2024-04-15T14:59:52.944781+0000","last_active":"2024-04-15T15:24:51.068419+0000","last_peered":"2024-04-15T15:24:51.068419+0000","last_clean":"2024-04-15T15:24:51.068419+0000","last_became_active":"2024-04-15T14:59:52.908707+0000","last_became_peered":"2024-04-15T14:59:52.908707+0000","last_unstale":"2024-04-15T15:24:51.068419+0000","last_undegraded":"2024-04-15T15:24:51.068419+0000","last_fullsized":"2024-04-15T15:24:51.068419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:51:14.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1894,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.074283+0000","last_change":"2024-04-15T15:01:38.091528+0000","last_active":"2024-04-15T15:24:51.074283+0000","last_peered":"2024-04-15T15:24:51.074283+0000","last_clean":"2024-04-15T15:24:51.074283+0000","last_became_active":"2024-04-15T15:01:37.900280+0000","last_became_peered":"2024-04-15T15:01:37.900280+0000","last_unstale":"2024-04-15T15:24:51.074283+0000","last_undegraded":"2024-04-15T15:24:51.074283+0000","last_fullsized":"2024-04-15T15:24:51.074283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:41.178094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1907,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.059219+0000","last_change":"2024-04-15T14:59:52.865828+0000","last_active":"2024-04-15T15:24:51.059219+0000","last_peered":"2024-04-15T15:24:51.059219+0000","last_clean":"2024-04-15T15:24:51.059219+0000","last_became_active":"2024-04-15T14:59:52.828831+0000","last_became_peered":"2024-04-15T14:59:52.828831+0000","last_unstale":"2024-04-15T15:24:51.059219+0000","last_undegraded":"2024-04-15T15:24:51.059219+0000","last_fullsized":"2024-04-15T15:24:51.059219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:49:13.712376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1893,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.763694+0000","last_change":"2024-04-15T15:01:57.832637+0000","last_active":"2024-04-15T15:24:52.763694+0000","last_peered":"2024-04-15T15:24:52.763694+0000","last_clean":"2024-04-15T15:24:52.763694+0000","last_became_active":"2024-04-15T15:01:57.822039+0000","last_became_peered":"2024-04-15T15:01:57.822039+0000","last_unstale":"2024-04-15T15:24:52.763694+0000","last_undegraded":"2024-04-15T15:24:52.763694+0000","last_fullsized":"2024-04-15T15:24:52.763694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:36:46.591238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1889,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.023774+0000","last_change":"2024-04-15T14:59:53.222610+0000","last_active":"2024-04-15T15:24:51.023774+0000","last_peered":"2024-04-15T15:24:51.023774+0000","last_clean":"2024-04-15T15:24:51.023774+0000","last_became_active":"2024-04-15T14:59:53.217062+0000","last_became_peered":"2024-04-15T14:59:53.217062+0000","last_unstale":"2024-04-15T15:24:51.023774+0000","last_undegraded":"2024-04-15T15:24:51.023774+0000","last_fullsized":"2024-04-15T15:24:51.023774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:15.523606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1892,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.125515+0000","last_change":"2024-04-15T15:01:44.637457+0000","last_active":"2024-04-15T15:24:51.125515+0000","last_peered":"2024-04-15T15:24:51.125515+0000","last_clean":"2024-04-15T15:24:51.125515+0000","last_became_active":"2024-04-15T15:01:44.538256+0000","last_became_peered":"2024-04-15T15:01:44.538256+0000","last_unstale":"2024-04-15T15:24:51.125515+0000","last_undegraded":"2024-04-15T15:24:51.125515+0000","last_fullsized":"2024-04-15T15:24:51.125515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:29:56.488170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1897,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.783476+0000","last_change":"2024-04-15T14:59:53.268620+0000","last_active":"2024-04-15T15:24:52.783476+0000","last_peered":"2024-04-15T15:24:52.783476+0000","last_clean":"2024-04-15T15:24:52.783476+0000","last_became_active":"2024-04-15T14:59:53.236225+0000","last_became_peered":"2024-04-15T14:59:53.236225+0000","last_unstale":"2024-04-15T15:24:52.783476+0000","last_undegraded":"2024-04-15T15:24:52.783476+0000","last_fullsized":"2024-04-15T15:24:52.783476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:02:24.955207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1877,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.844122+0000","last_change":"2024-04-15T15:01:59.581889+0000","last_active":"2024-04-15T15:24:50.844122+0000","last_peered":"2024-04-15T15:24:50.844122+0000","last_clean":"2024-04-15T15:24:50.844122+0000","last_became_active":"2024-04-15T15:01:59.575852+0000","last_became_peered":"2024-04-15T15:01:59.575852+0000","last_unstale":"2024-04-15T15:24:50.844122+0000","last_undegraded":"2024-04-15T15:24:50.844122+0000","last_fullsized":"2024-04-15T15:24:50.844122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:13:33.644867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1888,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.157899+0000","last_change":"2024-04-15T14:59:53.006767+0000","last_active":"2024-04-15T15:24:51.157899+0000","last_peered":"2024-04-15T15:24:51.157899+0000","last_clean":"2024-04-15T15:24:51.157899+0000","last_became_active":"2024-04-15T14:59:53.001226+0000","last_became_peered":"2024-04-15T14:59:53.001226+0000","last_unstale":"2024-04-15T15:24:51.157899+0000","last_undegraded":"2024-04-15T15:24:51.157899+0000","last_fullsized":"2024-04-15T15:24:51.157899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:24:19.402932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.899463+0000","last_change":"2024-04-15T15:01:53.665706+0000","last_active":"2024-04-15T15:24:50.899463+0000","last_peered":"2024-04-15T15:24:50.899463+0000","last_clean":"2024-04-15T15:24:50.899463+0000","last_became_active":"2024-04-15T15:01:53.660325+0000","last_became_peered":"2024-04-15T15:01:53.660325+0000","last_unstale":"2024-04-15T15:24:50.899463+0000","last_undegraded":"2024-04-15T15:24:50.899463+0000","last_fullsized":"2024-04-15T15:24:50.899463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:05:10.873866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1903,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.912217+0000","last_change":"2024-04-15T14:59:53.351131+0000","last_active":"2024-04-15T15:24:50.912217+0000","last_peered":"2024-04-15T15:24:50.912217+0000","last_clean":"2024-04-15T15:24:50.912217+0000","last_became_active":"2024-04-15T14:59:53.319031+0000","last_became_peered":"2024-04-15T14:59:53.319031+0000","last_unstale":"2024-04-15T15:24:50.912217+0000","last_undegraded":"2024-04-15T15:24:50.912217+0000","last_fullsized":"2024-04-15T15:24:50.912217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:02:06.831069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1894,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.097686+0000","last_change":"2024-04-15T15:01:36.591333+0000","last_active":"2024-04-15T15:24:51.097686+0000","last_peered":"2024-04-15T15:24:51.097686+0000","last_clean":"2024-04-15T15:24:51.097686+0000","last_became_active":"2024-04-15T15:01:36.581212+0000","last_became_peered":"2024-04-15T15:01:36.581212+0000","last_unstale":"2024-04-15T15:24:51.097686+0000","last_undegraded":"2024-04-15T15:24:51.097686+0000","last_fullsized":"2024-04-15T15:24:51.097686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:25:08.293854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1886,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.142521+0000","last_change":"2024-04-15T14:59:53.315692+0000","last_active":"2024-04-15T15:24:51.142521+0000","last_peered":"2024-04-15T15:24:51.142521+0000","last_clean":"2024-04-15T15:24:51.142521+0000","last_became_active":"2024-04-15T14:59:53.310268+0000","last_became_peered":"2024-04-15T14:59:53.310268+0000","last_unstale":"2024-04-15T15:24:51.142521+0000","last_undegraded":"2024-04-15T15:24:51.142521+0000","last_fullsized":"2024-04-15T15:24:51.142521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:16:52.167819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.879815+0000","last_change":"2024-04-15T15:01:53.629947+0000","last_active":"2024-04-15T15:24:50.879815+0000","last_peered":"2024-04-15T15:24:50.879815+0000","last_clean":"2024-04-15T15:24:50.879815+0000","last_became_active":"2024-04-15T15:01:53.609717+0000","last_became_peered":"2024-04-15T15:01:53.609717+0000","last_unstale":"2024-04-15T15:24:50.879815+0000","last_undegraded":"2024-04-15T15:24:50.879815+0000","last_fullsized":"2024-04-15T15:24:50.879815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:32:01.075020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1873,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.110863+0000","last_change":"2024-04-15T15:01:42.779951+0000","last_active":"2024-04-15T15:24:51.110863+0000","last_peered":"2024-04-15T15:24:51.110863+0000","last_clean":"2024-04-15T15:24:51.110863+0000","last_became_active":"2024-04-15T15:01:42.774408+0000","last_became_peered":"2024-04-15T15:01:42.774408+0000","last_unstale":"2024-04-15T15:24:51.110863+0000","last_undegraded":"2024-04-15T15:24:51.110863+0000","last_fullsized":"2024-04-15T15:24:51.110863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:05.785898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1880,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.903335+0000","last_change":"2024-04-15T15:01:58.212111+0000","last_active":"2024-04-15T15:24:50.903335+0000","last_peered":"2024-04-15T15:24:50.903335+0000","last_clean":"2024-04-15T15:24:50.903335+0000","last_became_active":"2024-04-15T15:01:58.202626+0000","last_became_peered":"2024-04-15T15:01:58.202626+0000","last_unstale":"2024-04-15T15:24:50.903335+0000","last_undegraded":"2024-04-15T15:24:50.903335+0000","last_fullsized":"2024-04-15T15:24:50.903335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:06.026358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1880,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.891363+0000","last_change":"2024-04-15T15:01:54.211646+0000","last_active":"2024-04-15T15:24:50.891363+0000","last_peered":"2024-04-15T15:24:50.891363+0000","last_clean":"2024-04-15T15:24:50.891363+0000","last_became_active":"2024-04-15T15:01:54.206258+0000","last_became_peered":"2024-04-15T15:01:54.206258+0000","last_unstale":"2024-04-15T15:24:50.891363+0000","last_undegraded":"2024-04-15T15:24:50.891363+0000","last_fullsized":"2024-04-15T15:24:50.891363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:10:44.038067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1895,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.070662+0000","last_change":"2024-04-15T15:01:43.288156+0000","last_active":"2024-04-15T15:24:51.070662+0000","last_peered":"2024-04-15T15:24:51.070662+0000","last_clean":"2024-04-15T15:24:51.070662+0000","last_became_active":"2024-04-15T15:01:43.261603+0000","last_became_peered":"2024-04-15T15:01:43.261603+0000","last_unstale":"2024-04-15T15:24:51.070662+0000","last_undegraded":"2024-04-15T15:24:51.070662+0000","last_fullsized":"2024-04-15T15:24:51.070662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:24:52.000881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1893,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.757022+0000","last_change":"2024-04-15T15:01:58.020146+0000","last_active":"2024-04-15T15:24:52.757022+0000","last_peered":"2024-04-15T15:24:52.757022+0000","last_clean":"2024-04-15T15:24:52.757022+0000","last_became_active":"2024-04-15T15:01:58.007306+0000","last_became_peered":"2024-04-15T15:01:58.007306+0000","last_unstale":"2024-04-15T15:24:52.757022+0000","last_undegraded":"2024-04-15T15:24:52.757022+0000","last_fullsized":"2024-04-15T15:24:52.757022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:51:31.200321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1879,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.854726+0000","last_change":"2024-04-15T15:01:53.764775+0000","last_active":"2024-04-15T15:24:50.854726+0000","last_peered":"2024-04-15T15:24:50.854726+0000","last_clean":"2024-04-15T15:24:50.854726+0000","last_became_active":"2024-04-15T15:01:53.747318+0000","last_became_peered":"2024-04-15T15:01:53.747318+0000","last_unstale":"2024-04-15T15:24:50.854726+0000","last_undegraded":"2024-04-15T15:24:50.854726+0000","last_fullsized":"2024-04-15T15:24:50.854726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:26:07.121772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":989,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.066403+0000","last_change":"2024-04-15T15:11:58.160174+0000","last_active":"2024-04-15T15:24:51.066403+0000","last_peered":"2024-04-15T15:24:51.066403+0000","last_clean":"2024-04-15T15:24:51.066403+0000","last_became_active":"2024-04-15T15:11:58.147973+0000","last_became_peered":"2024-04-15T15:11:58.147973+0000","last_unstale":"2024-04-15T15:24:51.066403+0000","last_undegraded":"2024-04-15T15:24:51.066403+0000","last_fullsized":"2024-04-15T15:24:51.066403+0000","mapping_epoch":488,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":489,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:41:39.100310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1883,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.780310+0000","last_change":"2024-04-15T15:01:50.350153+0000","last_active":"2024-04-15T15:24:52.780310+0000","last_peered":"2024-04-15T15:24:52.780310+0000","last_clean":"2024-04-15T15:24:52.780310+0000","last_became_active":"2024-04-15T15:01:50.337533+0000","last_became_peered":"2024-04-15T15:01:50.337533+0000","last_unstale":"2024-04-15T15:24:52.780310+0000","last_undegraded":"2024-04-15T15:24:52.780310+0000","last_fullsized":"2024-04-15T15:24:52.780310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:13:36.423971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1892,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.123543+0000","last_change":"2024-04-15T15:01:38.478868+0000","last_active":"2024-04-15T15:24:51.123543+0000","last_peered":"2024-04-15T15:24:51.123543+0000","last_clean":"2024-04-15T15:24:51.123543+0000","last_became_active":"2024-04-15T15:01:38.420878+0000","last_became_peered":"2024-04-15T15:01:38.420878+0000","last_unstale":"2024-04-15T15:24:51.123543+0000","last_undegraded":"2024-04-15T15:24:51.123543+0000","last_fullsized":"2024-04-15T15:24:51.123543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:10.994698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1856,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.703271+0000","last_change":"2024-04-15T15:01:41.056228+0000","last_active":"2024-04-15T15:24:49.703271+0000","last_peered":"2024-04-15T15:24:49.703271+0000","last_clean":"2024-04-15T15:24:49.703271+0000","last_became_active":"2024-04-15T15:01:40.945764+0000","last_became_peered":"2024-04-15T15:01:40.945764+0000","last_unstale":"2024-04-15T15:24:49.703271+0000","last_undegraded":"2024-04-15T15:24:49.703271+0000","last_fullsized":"2024-04-15T15:24:49.703271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:50:25.275328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1857,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.715419+0000","last_change":"2024-04-15T15:01:38.387944+0000","last_active":"2024-04-15T15:24:49.715419+0000","last_peered":"2024-04-15T15:24:49.715419+0000","last_clean":"2024-04-15T15:24:49.715419+0000","last_became_active":"2024-04-15T15:01:37.967524+0000","last_became_peered":"2024-04-15T15:01:37.967524+0000","last_unstale":"2024-04-15T15:24:49.715419+0000","last_undegraded":"2024-04-15T15:24:49.715419+0000","last_fullsized":"2024-04-15T15:24:49.715419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.864691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":2,"up_from":24,"seq":103079215407,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82860,"kb_used_data":7260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288980,"statfs":{"total":96636764160,"available":96551915520,"internally_reserved":0,"allocated":7434240,"data_stored":3468022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784248111,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82896,"kb_used_data":7300,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288944,"statfs":{"total":96636764160,"available":96551878656,"internally_reserved":0,"allocated":7475200,"data_stored":3494056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":100,"apply_latency_ms":100,"commit_latency_ns":100000000,"apply_latency_ns":100000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313522,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70548,"kb_used_data":7424,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301292,"statfs":{"total":96636764160,"available":96564523008,"internally_reserved":0,"allocated":7602176,"data_stored":3621032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":89,"apply_latency_ms":89,"commit_latency_ns":89000000,"apply_latency_ns":89000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313519,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70800,"kb_used_data":7680,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301040,"statfs":{"total":96636764160,"available":96564264960,"internally_reserved":0,"allocated":7864320,"data_stored":3863091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":88,"apply_latency_ms":88,"commit_latency_ns":88000000,"apply_latency_ns":88000000},"alerts":[]},{"osd":4,"up_from":20,"seq":85899346223,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70388,"kb_used_data":7268,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301452,"statfs":{"total":96636764160,"available":96564686848,"internally_reserved":0,"allocated":7442432,"data_stored":3470993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":80,"apply_latency_ms":80,"commit_latency_ns":80000000,"apply_latency_ns":80000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477039,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74968,"kb_used_data":7684,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296872,"statfs":{"total":96636764160,"available":96559996928,"internally_reserved":0,"allocated":7868416,"data_stored":3889318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477039,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82856,"kb_used_data":7256,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288984,"statfs":{"total":96636764160,"available":96551919616,"internally_reserved":0,"allocated":7430144,"data_stored":3458705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575154,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74560,"kb_used_data":7280,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94297280,"statfs":{"total":96636764160,"available":96560414720,"internally_reserved":0,"allocated":7454720,"data_stored":3459670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:24:55.071 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:24:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.172+0000 7f77a20c8640 10 monclient: get_monmap_and_config 2024-04-15T15:24:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.172+0000 7f77a20c8640 10 monclient: build_initial_monmap 2024-04-15T15:24:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.172+0000 7f77a20c8640 10 monclient: monmap: 2024-04-15T15:24:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:24:55.173620+0000 2024-04-15T15:24:55.174 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:24:55.173620+0000 2024-04-15T15:24:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:24:55.175 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:24:55.175 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.173+0000 7f77a20c8640 1 Processor -- start 2024-04-15T15:24:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.173+0000 7f77a20c8640 1 -- start start 2024-04-15T15:24:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.173+0000 7f77a20c8640 10 monclient: init 2024-04-15T15:24:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:24:55.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 10 monclient(hunting): picked mon.noname-c con 0x7f779c0aa6d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 10 monclient(hunting): picked mon.noname-b con 0x7f779c0ac320 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 10 monclient(hunting): picked mon.noname-a con 0x7f779c13d380 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c0abf60 con 0x7f779c13d380 2024-04-15T15:24:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c0acdc0 con 0x7f779c0aa6d0 2024-04-15T15:24:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c0acf90 con 0x7f779c0ac320 2024-04-15T15:24:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f77a20c8640 10 monclient(hunting): authenticate will time out at 2955.444766s 2024-04-15T15:24:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f779affd640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f779c0ac320 0x7f779c0ae3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:55972/0 (socket says 172.21.15.38:55972) 2024-04-15T15:24:55.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.174+0000 7f779affd640 1 -- 172.21.15.38:0/1097964535 learned_addr learned my addr 172.21.15.38:0/1097964535 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432074155 0 0) 0x7f7790001110 con 0x7f779c0ac320 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): my global_id is 81008 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7784003520 con 0x7f779c0ac320 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752729032 0 0) 0x7f779c0acdc0 con 0x7f779c0aa6d0 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): my global_id is 32257 2024-04-15T15:24:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7790001110 con 0x7f779c0aa6d0 2024-04-15T15:24:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225731584 0 0) 0x7f779c0abf60 con 0x7f779c13d380 2024-04-15T15:24:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 10 monclient(hunting): my global_id is 33543 2024-04-15T15:24:55.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.177+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f779c0acdc0 con 0x7f779c13d380 2024-04-15T15:24:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 97538288 0 0) 0x7f7790001110 con 0x7f779c0aa6d0 2024-04-15T15:24:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 >> v1:172.21.15.38:6790/0 conn(0x7f779c0ac320 legacy=0x7f779c0ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 >> v1:172.21.15.38:6789/0 conn(0x7f779c13d380 legacy=0x7f779c14b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 10 monclient: _finish_hunting 0 2024-04-15T15:24:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 1 monclient: found mon.noname-c 2024-04-15T15:24:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:24:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c13d830 con 0x7f779c0aa6d0 2024-04-15T15:24:55.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 10 monclient: _finish_auth 0 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 10 monclient: _check_auth_tickets 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f778c0015f0 con 0x7f779c0aa6d0 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f779a7fc640 10 monclient: dump: 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.183 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.184 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f77a20c8640 5 monclient: authenticate success, global_id 32257 2024-04-15T15:24:55.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.180+0000 7f77a20c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.182+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f778c001850 con 0x7f779c0aa6d0 2024-04-15T15:24:55.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.182+0000 7f779a7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.182+0000 7f779a7fc640 1 -- 172.21.15.38:0/1097964535 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f778c001c60 con 0x7f779c0aa6d0 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.182+0000 7f77a20c8640 10 monclient: get_monmap_and_config success 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.182+0000 7f77a20c8640 4 set_mon_vals no callback set 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.182+0000 7f779a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.182+0000 7f779a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.182+0000 7f779a7fc640 10 monclient: dump: 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.186 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.183+0000 7f77a20c8640 10 monclient: shutdown 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.183+0000 7f77a20c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.183+0000 7f77a20c8640 1 -- 172.21.15.38:0/1097964535 >> v1:172.21.15.164:6789/0 conn(0x7f779c0aa6d0 legacy=0x7f779c073200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.183+0000 7f77a20c8640 1 -- 172.21.15.38:0/1097964535 shutdown_connections 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.183+0000 7f77a20c8640 1 -- 172.21.15.38:0/1097964535 >> 172.21.15.38:0/1097964535 conn(0x7f779c068140 msgr2=0x7f779c0b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.183+0000 7f77a20c8640 1 -- 172.21.15.38:0/1097964535 shutdown_connections 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.183+0000 7f77a20c8640 1 -- 172.21.15.38:0/1097964535 wait complete. 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.183+0000 7f77a20c8640 10 monclient: build_initial_monmap 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.183+0000 7f77a20c8640 10 monclient: monmap: 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:24:55.187 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.184+0000 7f77a20c8640 1 librados: starting msgr at 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.184+0000 7f77a20c8640 1 librados: starting objecter 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.184+0000 7f77a20c8640 1 Processor -- start 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.184+0000 7f77a20c8640 1 -- start start 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.184+0000 7f77a20c8640 1 librados: setting wanted keys 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.184+0000 7f77a20c8640 1 librados: calling monclient init 2024-04-15T15:24:55.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.184+0000 7f77a20c8640 10 monclient: init 2024-04-15T15:24:55.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 10 monclient(hunting): picked mon.noname-c con 0x7f779c0aa6d0 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 10 monclient(hunting): picked mon.noname-b con 0x7f779c0ac320 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 10 monclient(hunting): picked mon.noname-a con 0x7f779c13d380 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c1422d0 con 0x7f779c13d380 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c143430 con 0x7f779c0ac320 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c1489e0 con 0x7f779c0aa6d0 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f77a20c8640 10 monclient(hunting): authenticate will time out at 2955.455544s 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f779b7fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f779c0aa6d0 0x7f779c142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:55984/0 (socket says 172.21.15.38:55984) 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f779b7fe640 1 -- 172.21.15.38:0/1393545791 learned_addr learned my addr 172.21.15.38:0/1393545791 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f7783fff640 10 client.?.objecter ms_handle_connect 0x7f779c0ac320 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f7783fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:55.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f7783fff640 10 client.?.objecter ms_handle_connect 0x7f779c0aa6d0 2024-04-15T15:24:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.185+0000 7f7783fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:55.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203063984 0 0) 0x7f779c143430 con 0x7f779c0ac320 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 10 monclient(hunting): my global_id is 32260 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7788004ee0 con 0x7f779c0ac320 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474670786 0 0) 0x7f779c1489e0 con 0x7f779c0aa6d0 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.187+0000 7f7783fff640 10 monclient(hunting): my global_id is 81011 2024-04-15T15:24:55.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.188+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f779c143430 con 0x7f779c0aa6d0 2024-04-15T15:24:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.192+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2999677621 0 0) 0x7f7788004ee0 con 0x7f779c0ac320 2024-04-15T15:24:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.192+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f779c1489e0 con 0x7f779c0ac320 2024-04-15T15:24:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.192+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7790001aa0 con 0x7f779c0ac320 2024-04-15T15:24:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.192+0000 7f7783fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.192+0000 7f7783fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:24:55.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.192+0000 7f7783fff640 10 monclient(hunting): dump: 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.192+0000 7f7783fff640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.193+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1925838091 0 0) 0x7f779c143430 con 0x7f779c0aa6d0 2024-04-15T15:24:55.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.193+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7788004ee0 con 0x7f779c0aa6d0 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.193+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f778c001ca0 con 0x7f779c0aa6d0 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.193+0000 7f7783fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.193+0000 7f7783fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.193+0000 7f7783fff640 10 monclient(hunting): dump: 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.196 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4287875463 0 0) 0x7f779c1489e0 con 0x7f779c0ac320 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 >> v1:172.21.15.38:6790/0 conn(0x7f779c0aa6d0 legacy=0x7f779c142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 >> v1:172.21.15.38:6789/0 conn(0x7f779c13d380 legacy=0x7f779c13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 10 monclient: _finish_hunting 0 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 1 monclient: found mon.b 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c149850 con 0x7f779c0ac320 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 10 monclient: _finish_auth 0 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 10 monclient: _check_auth_tickets 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f7783fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:55.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f77a20c8640 5 monclient: authenticate success, global_id 32260 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f77a20c8640 10 monclient: _renew_subs 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f77a20c8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f779c149b30 con 0x7f779c0ac320 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f77a20c8640 10 client.32260.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f77a20c8640 10 monclient: _renew_subs 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f77a20c8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f779c1337a0 con 0x7f779c0ac320 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.195+0000 7f77a20c8640 1 librados: init done 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.196+0000 7f77a20c8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.196+0000 7f77a20c8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.196+0000 7f77a20c8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:55.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.196+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779c13f5c0 con 0x7f779c0ac320 2024-04-15T15:24:55.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.197+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77900047e0 con 0x7f779c0ac320 2024-04-15T15:24:55.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.197+0000 7f7783fff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:55.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.197+0000 7f7799ffb640 4 set_mon_vals no callback set 2024-04-15T15:24:55.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.445+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7790004b30 con 0x7f779c0ac320 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.445+0000 7f7783fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.445+0000 7f7783fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.445+0000 7f7783fff640 10 monclient: dump: 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.447 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.446+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f779001b060 con 0x7f779c0ac320 2024-04-15T15:24:55.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.446+0000 7f779b7fe640 10 monclient: get_auth_request con 0x7f778806ed70 auth_method 0 2024-04-15T15:24:55.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.447+0000 7f7783fff640 10 client.32260.objecter ms_handle_connect 0x7f778806ed70 2024-04-15T15:24:55.450 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.449+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(995..995 src has 501..995) ==== 5226+0+0 (unknown 354831944 0 0) 0x7f7790053470 con 0x7f779c0ac320 2024-04-15T15:24:55.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.449+0000 7f7783fff640 10 client.32260.objecter ms_dispatch 0x7f779c000b90 osd_map(995..995 src has 501..995) 2024-04-15T15:24:55.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.449+0000 7f7783fff640 3 client.32260.objecter handle_osd_map got epochs [995,995] > 0 2024-04-15T15:24:55.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.449+0000 7f7783fff640 3 client.32260.objecter handle_osd_map decoding full epoch 995 2024-04-15T15:24:55.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.449+0000 7f7783fff640 20 client.32260.objecter dump_active .. 0 homeless 2024-04-15T15:24:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.451+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f779c13f5c0 con 0x7f779c0ac320 2024-04-15T15:24:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.451+0000 7f7783fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.451+0000 7f7783fff640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:24:55.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.637+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f779c077050 con 0x7f778806ed70 2024-04-15T15:24:55.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.640+0000 7f7783fff640 1 -- 172.21.15.38:0/1393545791 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+116281 (unknown 2965378022 0 3358038367) 0x7f779c077050 con 0x7f778806ed70 2024-04-15T15:24:55.642 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T15:24:55.643 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-15T15:24:55.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 10 librados: watch_flush enter 2024-04-15T15:24:55.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 10 librados: watch_flush exit 2024-04-15T15:24:55.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 20 client.32260.objecter shutdown clearing up homeless session... 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 10 client.32260.objecter successfully canceled tick 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 >> v1:172.21.15.38:6800/1608957829 conn(0x7f778806ed70 legacy=0x7f7788071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 10 monclient: shutdown 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 >> v1:172.21.15.164:6789/0 conn(0x7f779c0ac320 legacy=0x7f779c132eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 shutdown_connections 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 >> 172.21.15.38:0/1393545791 conn(0x7f779c068140 msgr2=0x7f779c06aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 shutdown_connections 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 1 -- 172.21.15.38:0/1393545791 wait complete. 2024-04-15T15:24:55.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.642+0000 7f77a20c8640 1 librados: shutdown 2024-04-15T15:24:55.654 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1758,"stamp":"2024-04-15T15:24:55.185095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":609876,"kb_used_data":59152,"kb_used_omap":12,"kb_used_meta":550579,"kb_avail":754364844,"statfs":{"total":773094113280,"available":772469600256,"internally_reserved":0,"allocated":60571648,"data_stored":28724887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":563793457},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":552,"apply_latency_ms":552,"commit_latency_ns":552000000,"apply_latency_ns":552000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000309,"num_objects":-45,"num_object_clones":-1,"num_object_copies":-135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-45,"num_whiteouts":0,"num_read":-30,"num_read_kb":-10,"num_write":-70,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.429142"},"pg_stats":[{"pgid":"16.0","version":"0'0","reported_seq":1886,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.761965+0000","last_change":"2024-04-15T15:01:50.438639+0000","last_active":"2024-04-15T15:24:52.761965+0000","last_peered":"2024-04-15T15:24:52.761965+0000","last_clean":"2024-04-15T15:24:52.761965+0000","last_became_active":"2024-04-15T15:01:50.426257+0000","last_became_peered":"2024-04-15T15:01:50.426257+0000","last_unstale":"2024-04-15T15:24:52.761965+0000","last_undegraded":"2024-04-15T15:24:52.761965+0000","last_fullsized":"2024-04-15T15:24:52.761965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:32:49.021840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1","version":"50'7","reported_seq":1907,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.749423+0000","last_change":"2024-04-15T15:01:58.061052+0000","last_active":"2024-04-15T15:24:52.749423+0000","last_peered":"2024-04-15T15:24:52.749423+0000","last_clean":"2024-04-15T15:24:52.749423+0000","last_became_active":"2024-04-15T15:01:58.055451+0000","last_became_peered":"2024-04-15T15:01:58.055451+0000","last_unstale":"2024-04-15T15:24:52.749423+0000","last_undegraded":"2024-04-15T15:24:52.749423+0000","last_fullsized":"2024-04-15T15:24:52.749423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:21:09.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1847,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.718058+0000","last_change":"2024-04-15T15:01:50.838864+0000","last_active":"2024-04-15T15:24:49.718058+0000","last_peered":"2024-04-15T15:24:49.718058+0000","last_clean":"2024-04-15T15:24:49.718058+0000","last_became_active":"2024-04-15T15:01:50.831566+0000","last_became_peered":"2024-04-15T15:01:50.831566+0000","last_unstale":"2024-04-15T15:24:49.718058+0000","last_undegraded":"2024-04-15T15:24:49.718058+0000","last_fullsized":"2024-04-15T15:24:49.718058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:16:57.027776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1874,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.058944+0000","last_change":"2024-04-15T15:01:37.314165+0000","last_active":"2024-04-15T15:24:51.058944+0000","last_peered":"2024-04-15T15:24:51.058944+0000","last_clean":"2024-04-15T15:24:51.058944+0000","last_became_active":"2024-04-15T15:01:37.307442+0000","last_became_peered":"2024-04-15T15:01:37.307442+0000","last_unstale":"2024-04-15T15:24:51.058944+0000","last_undegraded":"2024-04-15T15:24:51.058944+0000","last_fullsized":"2024-04-15T15:24:51.058944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:53:10.058304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.895591+0000","last_change":"2024-04-15T15:01:59.509650+0000","last_active":"2024-04-15T15:24:50.895591+0000","last_peered":"2024-04-15T15:24:50.895591+0000","last_clean":"2024-04-15T15:24:50.895591+0000","last_became_active":"2024-04-15T15:01:59.386200+0000","last_became_peered":"2024-04-15T15:01:59.386200+0000","last_unstale":"2024-04-15T15:24:50.895591+0000","last_undegraded":"2024-04-15T15:24:50.895591+0000","last_fullsized":"2024-04-15T15:24:50.895591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:48:58.277123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.830171+0000","last_change":"2024-04-15T15:01:59.531768+0000","last_active":"2024-04-15T15:24:50.830171+0000","last_peered":"2024-04-15T15:24:50.830171+0000","last_clean":"2024-04-15T15:24:50.830171+0000","last_became_active":"2024-04-15T15:01:59.475519+0000","last_became_peered":"2024-04-15T15:01:59.475519+0000","last_unstale":"2024-04-15T15:24:50.830171+0000","last_undegraded":"2024-04-15T15:24:50.830171+0000","last_fullsized":"2024-04-15T15:24:50.830171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:03:14.693476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1864,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.933158+0000","last_change":"2024-04-15T15:02:06.546089+0000","last_active":"2024-04-15T15:24:49.933158+0000","last_peered":"2024-04-15T15:24:49.933158+0000","last_clean":"2024-04-15T15:24:49.933158+0000","last_became_active":"2024-04-15T15:02:06.539897+0000","last_became_peered":"2024-04-15T15:02:06.539897+0000","last_unstale":"2024-04-15T15:24:49.933158+0000","last_undegraded":"2024-04-15T15:24:49.933158+0000","last_fullsized":"2024-04-15T15:24:49.933158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:37:56.830252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1845,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.744451+0000","last_change":"2024-04-15T15:01:56.856132+0000","last_active":"2024-04-15T15:24:49.744451+0000","last_peered":"2024-04-15T15:24:49.744451+0000","last_clean":"2024-04-15T15:24:49.744451+0000","last_became_active":"2024-04-15T15:01:56.846541+0000","last_became_peered":"2024-04-15T15:01:56.846541+0000","last_unstale":"2024-04-15T15:24:49.744451+0000","last_undegraded":"2024-04-15T15:24:49.744451+0000","last_fullsized":"2024-04-15T15:24:49.744451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:11:40.534644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1895,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.033567+0000","last_change":"2024-04-15T15:01:31.031846+0000","last_active":"2024-04-15T15:24:51.033567+0000","last_peered":"2024-04-15T15:24:51.033567+0000","last_clean":"2024-04-15T15:24:51.033567+0000","last_became_active":"2024-04-15T15:01:31.025154+0000","last_became_peered":"2024-04-15T15:01:31.025154+0000","last_unstale":"2024-04-15T15:24:51.033567+0000","last_undegraded":"2024-04-15T15:24:51.033567+0000","last_fullsized":"2024-04-15T15:24:51.033567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:58.719678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1872,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.019777+0000","last_change":"2024-04-15T15:01:47.686569+0000","last_active":"2024-04-15T15:24:51.019777+0000","last_peered":"2024-04-15T15:24:51.019777+0000","last_clean":"2024-04-15T15:24:51.019777+0000","last_became_active":"2024-04-15T15:01:47.652436+0000","last_became_peered":"2024-04-15T15:01:47.652436+0000","last_unstale":"2024-04-15T15:24:51.019777+0000","last_undegraded":"2024-04-15T15:24:51.019777+0000","last_fullsized":"2024-04-15T15:24:51.019777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:56:25.406881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1892,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.758941+0000","last_change":"2024-04-15T15:01:58.212389+0000","last_active":"2024-04-15T15:24:52.758941+0000","last_peered":"2024-04-15T15:24:52.758941+0000","last_clean":"2024-04-15T15:24:52.758941+0000","last_became_active":"2024-04-15T15:01:58.198421+0000","last_became_peered":"2024-04-15T15:01:58.198421+0000","last_unstale":"2024-04-15T15:24:52.758941+0000","last_undegraded":"2024-04-15T15:24:52.758941+0000","last_fullsized":"2024-04-15T15:24:52.758941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:07:05.883431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1878,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.675075+0000","last_change":"2024-04-15T15:01:58.537678+0000","last_active":"2024-04-15T15:24:49.675075+0000","last_peered":"2024-04-15T15:24:49.675075+0000","last_clean":"2024-04-15T15:24:49.675075+0000","last_became_active":"2024-04-15T15:01:58.520219+0000","last_became_peered":"2024-04-15T15:01:58.520219+0000","last_unstale":"2024-04-15T15:24:49.675075+0000","last_undegraded":"2024-04-15T15:24:49.675075+0000","last_fullsized":"2024-04-15T15:24:49.675075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:14:29.432422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1869,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.880251+0000","last_change":"2024-04-15T15:01:48.968180+0000","last_active":"2024-04-15T15:24:49.880251+0000","last_peered":"2024-04-15T15:24:49.880251+0000","last_clean":"2024-04-15T15:24:49.880251+0000","last_became_active":"2024-04-15T15:01:48.927422+0000","last_became_peered":"2024-04-15T15:01:48.927422+0000","last_unstale":"2024-04-15T15:24:49.880251+0000","last_undegraded":"2024-04-15T15:24:49.880251+0000","last_fullsized":"2024-04-15T15:24:49.880251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:03:54.276935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":2024,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.724026+0000","last_change":"2024-04-15T14:59:45.003334+0000","last_active":"2024-04-15T15:24:49.724026+0000","last_peered":"2024-04-15T15:24:49.724026+0000","last_clean":"2024-04-15T15:24:49.724026+0000","last_became_active":"2024-04-15T14:59:44.414489+0000","last_became_peered":"2024-04-15T14:59:44.414489+0000","last_unstale":"2024-04-15T15:24:49.724026+0000","last_undegraded":"2024-04-15T15:24:49.724026+0000","last_fullsized":"2024-04-15T15:24:49.724026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_clean_scrub_stamp":"2024-04-15T14:59:36.273099+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:03.807751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1888,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.061620+0000","last_change":"2024-04-15T14:59:53.285621+0000","last_active":"2024-04-15T15:24:51.061620+0000","last_peered":"2024-04-15T15:24:51.061620+0000","last_clean":"2024-04-15T15:24:51.061620+0000","last_became_active":"2024-04-15T14:59:53.276305+0000","last_became_peered":"2024-04-15T14:59:53.276305+0000","last_unstale":"2024-04-15T15:24:51.061620+0000","last_undegraded":"2024-04-15T15:24:51.061620+0000","last_fullsized":"2024-04-15T15:24:51.061620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:22:32.578057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1880,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.714070+0000","last_change":"2024-04-15T15:01:50.074053+0000","last_active":"2024-04-15T15:24:49.714070+0000","last_peered":"2024-04-15T15:24:49.714070+0000","last_clean":"2024-04-15T15:24:49.714070+0000","last_became_active":"2024-04-15T15:01:50.052081+0000","last_became_peered":"2024-04-15T15:01:50.052081+0000","last_unstale":"2024-04-15T15:24:49.714070+0000","last_undegraded":"2024-04-15T15:24:49.714070+0000","last_fullsized":"2024-04-15T15:24:49.714070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:30:25.217264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1889,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.068419+0000","last_change":"2024-04-15T14:59:52.944781+0000","last_active":"2024-04-15T15:24:51.068419+0000","last_peered":"2024-04-15T15:24:51.068419+0000","last_clean":"2024-04-15T15:24:51.068419+0000","last_became_active":"2024-04-15T14:59:52.908707+0000","last_became_peered":"2024-04-15T14:59:52.908707+0000","last_unstale":"2024-04-15T15:24:51.068419+0000","last_undegraded":"2024-04-15T15:24:51.068419+0000","last_fullsized":"2024-04-15T15:24:51.068419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:51:14.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1894,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.074283+0000","last_change":"2024-04-15T15:01:38.091528+0000","last_active":"2024-04-15T15:24:51.074283+0000","last_peered":"2024-04-15T15:24:51.074283+0000","last_clean":"2024-04-15T15:24:51.074283+0000","last_became_active":"2024-04-15T15:01:37.900280+0000","last_became_peered":"2024-04-15T15:01:37.900280+0000","last_unstale":"2024-04-15T15:24:51.074283+0000","last_undegraded":"2024-04-15T15:24:51.074283+0000","last_fullsized":"2024-04-15T15:24:51.074283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:41.178094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1907,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.059219+0000","last_change":"2024-04-15T14:59:52.865828+0000","last_active":"2024-04-15T15:24:51.059219+0000","last_peered":"2024-04-15T15:24:51.059219+0000","last_clean":"2024-04-15T15:24:51.059219+0000","last_became_active":"2024-04-15T14:59:52.828831+0000","last_became_peered":"2024-04-15T14:59:52.828831+0000","last_unstale":"2024-04-15T15:24:51.059219+0000","last_undegraded":"2024-04-15T15:24:51.059219+0000","last_fullsized":"2024-04-15T15:24:51.059219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:49:13.712376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1893,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.763694+0000","last_change":"2024-04-15T15:01:57.832637+0000","last_active":"2024-04-15T15:24:52.763694+0000","last_peered":"2024-04-15T15:24:52.763694+0000","last_clean":"2024-04-15T15:24:52.763694+0000","last_became_active":"2024-04-15T15:01:57.822039+0000","last_became_peered":"2024-04-15T15:01:57.822039+0000","last_unstale":"2024-04-15T15:24:52.763694+0000","last_undegraded":"2024-04-15T15:24:52.763694+0000","last_fullsized":"2024-04-15T15:24:52.763694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:36:46.591238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1889,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.023774+0000","last_change":"2024-04-15T14:59:53.222610+0000","last_active":"2024-04-15T15:24:51.023774+0000","last_peered":"2024-04-15T15:24:51.023774+0000","last_clean":"2024-04-15T15:24:51.023774+0000","last_became_active":"2024-04-15T14:59:53.217062+0000","last_became_peered":"2024-04-15T14:59:53.217062+0000","last_unstale":"2024-04-15T15:24:51.023774+0000","last_undegraded":"2024-04-15T15:24:51.023774+0000","last_fullsized":"2024-04-15T15:24:51.023774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:15.523606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1892,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.125515+0000","last_change":"2024-04-15T15:01:44.637457+0000","last_active":"2024-04-15T15:24:51.125515+0000","last_peered":"2024-04-15T15:24:51.125515+0000","last_clean":"2024-04-15T15:24:51.125515+0000","last_became_active":"2024-04-15T15:01:44.538256+0000","last_became_peered":"2024-04-15T15:01:44.538256+0000","last_unstale":"2024-04-15T15:24:51.125515+0000","last_undegraded":"2024-04-15T15:24:51.125515+0000","last_fullsized":"2024-04-15T15:24:51.125515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:29:56.488170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1897,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.783476+0000","last_change":"2024-04-15T14:59:53.268620+0000","last_active":"2024-04-15T15:24:52.783476+0000","last_peered":"2024-04-15T15:24:52.783476+0000","last_clean":"2024-04-15T15:24:52.783476+0000","last_became_active":"2024-04-15T14:59:53.236225+0000","last_became_peered":"2024-04-15T14:59:53.236225+0000","last_unstale":"2024-04-15T15:24:52.783476+0000","last_undegraded":"2024-04-15T15:24:52.783476+0000","last_fullsized":"2024-04-15T15:24:52.783476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:02:24.955207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1877,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.844122+0000","last_change":"2024-04-15T15:01:59.581889+0000","last_active":"2024-04-15T15:24:50.844122+0000","last_peered":"2024-04-15T15:24:50.844122+0000","last_clean":"2024-04-15T15:24:50.844122+0000","last_became_active":"2024-04-15T15:01:59.575852+0000","last_became_peered":"2024-04-15T15:01:59.575852+0000","last_unstale":"2024-04-15T15:24:50.844122+0000","last_undegraded":"2024-04-15T15:24:50.844122+0000","last_fullsized":"2024-04-15T15:24:50.844122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:13:33.644867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1888,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.157899+0000","last_change":"2024-04-15T14:59:53.006767+0000","last_active":"2024-04-15T15:24:51.157899+0000","last_peered":"2024-04-15T15:24:51.157899+0000","last_clean":"2024-04-15T15:24:51.157899+0000","last_became_active":"2024-04-15T14:59:53.001226+0000","last_became_peered":"2024-04-15T14:59:53.001226+0000","last_unstale":"2024-04-15T15:24:51.157899+0000","last_undegraded":"2024-04-15T15:24:51.157899+0000","last_fullsized":"2024-04-15T15:24:51.157899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:24:19.402932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.899463+0000","last_change":"2024-04-15T15:01:53.665706+0000","last_active":"2024-04-15T15:24:50.899463+0000","last_peered":"2024-04-15T15:24:50.899463+0000","last_clean":"2024-04-15T15:24:50.899463+0000","last_became_active":"2024-04-15T15:01:53.660325+0000","last_became_peered":"2024-04-15T15:01:53.660325+0000","last_unstale":"2024-04-15T15:24:50.899463+0000","last_undegraded":"2024-04-15T15:24:50.899463+0000","last_fullsized":"2024-04-15T15:24:50.899463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:05:10.873866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1903,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.912217+0000","last_change":"2024-04-15T14:59:53.351131+0000","last_active":"2024-04-15T15:24:50.912217+0000","last_peered":"2024-04-15T15:24:50.912217+0000","last_clean":"2024-04-15T15:24:50.912217+0000","last_became_active":"2024-04-15T14:59:53.319031+0000","last_became_peered":"2024-04-15T14:59:53.319031+0000","last_unstale":"2024-04-15T15:24:50.912217+0000","last_undegraded":"2024-04-15T15:24:50.912217+0000","last_fullsized":"2024-04-15T15:24:50.912217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:02:06.831069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1894,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.097686+0000","last_change":"2024-04-15T15:01:36.591333+0000","last_active":"2024-04-15T15:24:51.097686+0000","last_peered":"2024-04-15T15:24:51.097686+0000","last_clean":"2024-04-15T15:24:51.097686+0000","last_became_active":"2024-04-15T15:01:36.581212+0000","last_became_peered":"2024-04-15T15:01:36.581212+0000","last_unstale":"2024-04-15T15:24:51.097686+0000","last_undegraded":"2024-04-15T15:24:51.097686+0000","last_fullsized":"2024-04-15T15:24:51.097686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:25:08.293854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1886,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.142521+0000","last_change":"2024-04-15T14:59:53.315692+0000","last_active":"2024-04-15T15:24:51.142521+0000","last_peered":"2024-04-15T15:24:51.142521+0000","last_clean":"2024-04-15T15:24:51.142521+0000","last_became_active":"2024-04-15T14:59:53.310268+0000","last_became_peered":"2024-04-15T14:59:53.310268+0000","last_unstale":"2024-04-15T15:24:51.142521+0000","last_undegraded":"2024-04-15T15:24:51.142521+0000","last_fullsized":"2024-04-15T15:24:51.142521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:16:52.167819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.879815+0000","last_change":"2024-04-15T15:01:53.629947+0000","last_active":"2024-04-15T15:24:50.879815+0000","last_peered":"2024-04-15T15:24:50.879815+0000","last_clean":"2024-04-15T15:24:50.879815+0000","last_became_active":"2024-04-15T15:01:53.609717+0000","last_became_peered":"2024-04-15T15:01:53.609717+0000","last_unstale":"2024-04-15T15:24:50.879815+0000","last_undegraded":"2024-04-15T15:24:50.879815+0000","last_fullsized":"2024-04-15T15:24:50.879815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:32:01.075020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1873,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.110863+0000","last_change":"2024-04-15T15:01:42.779951+0000","last_active":"2024-04-15T15:24:51.110863+0000","last_peered":"2024-04-15T15:24:51.110863+0000","last_clean":"2024-04-15T15:24:51.110863+0000","last_became_active":"2024-04-15T15:01:42.774408+0000","last_became_peered":"2024-04-15T15:01:42.774408+0000","last_unstale":"2024-04-15T15:24:51.110863+0000","last_undegraded":"2024-04-15T15:24:51.110863+0000","last_fullsized":"2024-04-15T15:24:51.110863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:05.785898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1880,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.903335+0000","last_change":"2024-04-15T15:01:58.212111+0000","last_active":"2024-04-15T15:24:50.903335+0000","last_peered":"2024-04-15T15:24:50.903335+0000","last_clean":"2024-04-15T15:24:50.903335+0000","last_became_active":"2024-04-15T15:01:58.202626+0000","last_became_peered":"2024-04-15T15:01:58.202626+0000","last_unstale":"2024-04-15T15:24:50.903335+0000","last_undegraded":"2024-04-15T15:24:50.903335+0000","last_fullsized":"2024-04-15T15:24:50.903335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:06.026358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1880,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.891363+0000","last_change":"2024-04-15T15:01:54.211646+0000","last_active":"2024-04-15T15:24:50.891363+0000","last_peered":"2024-04-15T15:24:50.891363+0000","last_clean":"2024-04-15T15:24:50.891363+0000","last_became_active":"2024-04-15T15:01:54.206258+0000","last_became_peered":"2024-04-15T15:01:54.206258+0000","last_unstale":"2024-04-15T15:24:50.891363+0000","last_undegraded":"2024-04-15T15:24:50.891363+0000","last_fullsized":"2024-04-15T15:24:50.891363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:10:44.038067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1895,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.070662+0000","last_change":"2024-04-15T15:01:43.288156+0000","last_active":"2024-04-15T15:24:51.070662+0000","last_peered":"2024-04-15T15:24:51.070662+0000","last_clean":"2024-04-15T15:24:51.070662+0000","last_became_active":"2024-04-15T15:01:43.261603+0000","last_became_peered":"2024-04-15T15:01:43.261603+0000","last_unstale":"2024-04-15T15:24:51.070662+0000","last_undegraded":"2024-04-15T15:24:51.070662+0000","last_fullsized":"2024-04-15T15:24:51.070662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:24:52.000881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1893,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.757022+0000","last_change":"2024-04-15T15:01:58.020146+0000","last_active":"2024-04-15T15:24:52.757022+0000","last_peered":"2024-04-15T15:24:52.757022+0000","last_clean":"2024-04-15T15:24:52.757022+0000","last_became_active":"2024-04-15T15:01:58.007306+0000","last_became_peered":"2024-04-15T15:01:58.007306+0000","last_unstale":"2024-04-15T15:24:52.757022+0000","last_undegraded":"2024-04-15T15:24:52.757022+0000","last_fullsized":"2024-04-15T15:24:52.757022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:51:31.200321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1879,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.854726+0000","last_change":"2024-04-15T15:01:53.764775+0000","last_active":"2024-04-15T15:24:50.854726+0000","last_peered":"2024-04-15T15:24:50.854726+0000","last_clean":"2024-04-15T15:24:50.854726+0000","last_became_active":"2024-04-15T15:01:53.747318+0000","last_became_peered":"2024-04-15T15:01:53.747318+0000","last_unstale":"2024-04-15T15:24:50.854726+0000","last_undegraded":"2024-04-15T15:24:50.854726+0000","last_fullsized":"2024-04-15T15:24:50.854726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:26:07.121772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":989,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.066403+0000","last_change":"2024-04-15T15:11:58.160174+0000","last_active":"2024-04-15T15:24:51.066403+0000","last_peered":"2024-04-15T15:24:51.066403+0000","last_clean":"2024-04-15T15:24:51.066403+0000","last_became_active":"2024-04-15T15:11:58.147973+0000","last_became_peered":"2024-04-15T15:11:58.147973+0000","last_unstale":"2024-04-15T15:24:51.066403+0000","last_undegraded":"2024-04-15T15:24:51.066403+0000","last_fullsized":"2024-04-15T15:24:51.066403+0000","mapping_epoch":488,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":489,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:41:39.100310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1883,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.780310+0000","last_change":"2024-04-15T15:01:50.350153+0000","last_active":"2024-04-15T15:24:52.780310+0000","last_peered":"2024-04-15T15:24:52.780310+0000","last_clean":"2024-04-15T15:24:52.780310+0000","last_became_active":"2024-04-15T15:01:50.337533+0000","last_became_peered":"2024-04-15T15:01:50.337533+0000","last_unstale":"2024-04-15T15:24:52.780310+0000","last_undegraded":"2024-04-15T15:24:52.780310+0000","last_fullsized":"2024-04-15T15:24:52.780310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:13:36.423971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1892,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.123543+0000","last_change":"2024-04-15T15:01:38.478868+0000","last_active":"2024-04-15T15:24:51.123543+0000","last_peered":"2024-04-15T15:24:51.123543+0000","last_clean":"2024-04-15T15:24:51.123543+0000","last_became_active":"2024-04-15T15:01:38.420878+0000","last_became_peered":"2024-04-15T15:01:38.420878+0000","last_unstale":"2024-04-15T15:24:51.123543+0000","last_undegraded":"2024-04-15T15:24:51.123543+0000","last_fullsized":"2024-04-15T15:24:51.123543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:10.994698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1856,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.703271+0000","last_change":"2024-04-15T15:01:41.056228+0000","last_active":"2024-04-15T15:24:49.703271+0000","last_peered":"2024-04-15T15:24:49.703271+0000","last_clean":"2024-04-15T15:24:49.703271+0000","last_became_active":"2024-04-15T15:01:40.945764+0000","last_became_peered":"2024-04-15T15:01:40.945764+0000","last_unstale":"2024-04-15T15:24:49.703271+0000","last_undegraded":"2024-04-15T15:24:49.703271+0000","last_fullsized":"2024-04-15T15:24:49.703271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:50:25.275328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1857,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.715419+0000","last_change":"2024-04-15T15:01:38.387944+0000","last_active":"2024-04-15T15:24:49.715419+0000","last_peered":"2024-04-15T15:24:49.715419+0000","last_clean":"2024-04-15T15:24:49.715419+0000","last_became_active":"2024-04-15T15:01:37.967524+0000","last_became_peered":"2024-04-15T15:01:37.967524+0000","last_unstale":"2024-04-15T15:24:49.715419+0000","last_undegraded":"2024-04-15T15:24:49.715419+0000","last_fullsized":"2024-04-15T15:24:49.715419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.864691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":2,"up_from":24,"seq":103079215407,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82860,"kb_used_data":7260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288980,"statfs":{"total":96636764160,"available":96551915520,"internally_reserved":0,"allocated":7434240,"data_stored":3468022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784248111,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82896,"kb_used_data":7300,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288944,"statfs":{"total":96636764160,"available":96551878656,"internally_reserved":0,"allocated":7475200,"data_stored":3494056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":100,"apply_latency_ms":100,"commit_latency_ns":100000000,"apply_latency_ns":100000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313522,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70548,"kb_used_data":7424,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301292,"statfs":{"total":96636764160,"available":96564523008,"internally_reserved":0,"allocated":7602176,"data_stored":3621032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":89,"apply_latency_ms":89,"commit_latency_ns":89000000,"apply_latency_ns":89000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313519,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70800,"kb_used_data":7680,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301040,"statfs":{"total":96636764160,"available":96564264960,"internally_reserved":0,"allocated":7864320,"data_stored":3863091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":88,"apply_latency_ms":88,"commit_latency_ns":88000000,"apply_latency_ns":88000000},"alerts":[]},{"osd":4,"up_from":20,"seq":85899346223,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70388,"kb_used_data":7268,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301452,"statfs":{"total":96636764160,"available":96564686848,"internally_reserved":0,"allocated":7442432,"data_stored":3470993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":80,"apply_latency_ms":80,"commit_latency_ns":80000000,"apply_latency_ns":80000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477039,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74968,"kb_used_data":7684,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296872,"statfs":{"total":96636764160,"available":96559996928,"internally_reserved":0,"allocated":7868416,"data_stored":3889318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477039,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82856,"kb_used_data":7256,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288984,"statfs":{"total":96636764160,"available":96551919616,"internally_reserved":0,"allocated":7430144,"data_stored":3458705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575154,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74560,"kb_used_data":7280,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94297280,"statfs":{"total":96636764160,"available":96560414720,"internally_reserved":0,"allocated":7454720,"data_stored":3459670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:24:55.656 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T15:24:55.657 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:24:55.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.760+0000 7f094b93d640 10 monclient: get_monmap_and_config 2024-04-15T15:24:55.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.760+0000 7f094b93d640 10 monclient: build_initial_monmap 2024-04-15T15:24:55.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.760+0000 7f094b93d640 10 monclient: monmap: 2024-04-15T15:24:55.762 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:55.762 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.762 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:24:55.761327+0000 2024-04-15T15:24:55.762 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:24:55.761327+0000 2024-04-15T15:24:55.762 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:55.763 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.763 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:55.763 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:24:55.763 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:24:55.763 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.761+0000 7f094b93d640 1 Processor -- start 2024-04-15T15:24:55.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.761+0000 7f094b93d640 1 -- start start 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.761+0000 7f094b93d640 10 monclient: init 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 10 monclient(hunting): picked mon.noname-b con 0x7f09440b57d0 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 10 monclient(hunting): picked mon.noname-a con 0x7f09440b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 10 monclient(hunting): picked mon.noname-c con 0x7f0944140b30 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0944146e10 con 0x7f09440b5bb0 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09440aa840 con 0x7f0944140b30 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09440aa460 con 0x7f09440b57d0 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f094b93d640 10 monclient(hunting): authenticate will time out at 2956.032565s 2024-04-15T15:24:55.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f0949eda640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0944140b30 0x7f094414ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:52800/0 (socket says 172.21.15.38:52800) 2024-04-15T15:24:55.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.762+0000 7f0949eda640 1 -- 172.21.15.38:0/1895829722 learned_addr learned my addr 172.21.15.38:0/1895829722 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:55.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 853804201 0 0) 0x7f09440aa840 con 0x7f0944140b30 2024-04-15T15:24:55.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 10 monclient(hunting): my global_id is 32263 2024-04-15T15:24:55.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0930003520 con 0x7f0944140b30 2024-04-15T15:24:55.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919917862 0 0) 0x7f09440aa460 con 0x7f09440b57d0 2024-04-15T15:24:55.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.765+0000 7f093bfff640 10 monclient(hunting): my global_id is 81014 2024-04-15T15:24:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.766+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09440aa840 con 0x7f09440b57d0 2024-04-15T15:24:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.766+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180522454 0 0) 0x7f0944146e10 con 0x7f09440b5bb0 2024-04-15T15:24:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.766+0000 7f093bfff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.766+0000 7f093bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.766+0000 7f093bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.766+0000 7f093bfff640 10 monclient(hunting): my global_id is 33546 2024-04-15T15:24:55.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.766+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09440aa460 con 0x7f09440b5bb0 2024-04-15T15:24:55.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4234702191 0 0) 0x7f0930003520 con 0x7f0944140b30 2024-04-15T15:24:55.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 >> v1:172.21.15.38:6790/0 conn(0x7f09440b57d0 legacy=0x7f0944146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 >> v1:172.21.15.38:6789/0 conn(0x7f09440b5bb0 legacy=0x7f0944140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 10 monclient: _finish_hunting 0 2024-04-15T15:24:55.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 1 monclient: found mon.noname-c 2024-04-15T15:24:55.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09440b2970 con 0x7f0944140b30 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 10 monclient: _finish_auth 0 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 10 monclient: _check_auth_tickets 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f093c001990 con 0x7f0944140b30 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f093bfff640 10 monclient: dump: 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.771 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.772 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.772 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.772 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.772 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.772 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.772 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.772 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f094b93d640 5 monclient: authenticate success, global_id 32263 2024-04-15T15:24:55.772 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.768+0000 7f094b93d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:55.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.770+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f093c001bf0 con 0x7f0944140b30 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.770+0000 7f093bfff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.770+0000 7f093bfff640 1 -- 172.21.15.38:0/1895829722 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f093c001fc0 con 0x7f0944140b30 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.770+0000 7f094b93d640 10 monclient: get_monmap_and_config success 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.770+0000 7f094b93d640 4 set_mon_vals no callback set 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.770+0000 7f093bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.770+0000 7f093bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.770+0000 7f093bfff640 10 monclient: dump: 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.776 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.771+0000 7f094b93d640 10 monclient: shutdown 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.771+0000 7f094b93d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.771+0000 7f094b93d640 1 -- 172.21.15.38:0/1895829722 >> v1:172.21.15.164:6789/0 conn(0x7f0944140b30 legacy=0x7f094414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.771+0000 7f094b93d640 1 -- 172.21.15.38:0/1895829722 shutdown_connections 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.771+0000 7f094b93d640 1 -- 172.21.15.38:0/1895829722 >> 172.21.15.38:0/1895829722 conn(0x7f0944067790 msgr2=0x7f0944067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:55.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.771+0000 7f094b93d640 1 -- 172.21.15.38:0/1895829722 shutdown_connections 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.771+0000 7f094b93d640 1 -- 172.21.15.38:0/1895829722 wait complete. 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.772+0000 7f094b93d640 10 monclient: build_initial_monmap 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.772+0000 7f094b93d640 10 monclient: monmap: 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:24:55.778 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.772+0000 7f094b93d640 1 librados: starting msgr at 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.772+0000 7f094b93d640 1 librados: starting objecter 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.772+0000 7f094b93d640 1 Processor -- start 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.772+0000 7f094b93d640 1 -- start start 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.772+0000 7f094b93d640 1 librados: setting wanted keys 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.772+0000 7f094b93d640 1 librados: calling monclient init 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.772+0000 7f094b93d640 10 monclient: init 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 10 monclient(hunting): picked mon.noname-b con 0x7f09440b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 10 monclient(hunting): picked mon.noname-c con 0x7f09440b5bb0 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 10 monclient(hunting): picked mon.noname-a con 0x7f0944140b30 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:55.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09440adc00 con 0x7f0944140b30 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0944139830 con 0x7f09440b57d0 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09440ade70 con 0x7f09440b5bb0 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f094b93d640 10 monclient(hunting): authenticate will time out at 2956.043558s 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f0949eda640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0944140b30 0x7f0944139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44138/0 (socket says 172.21.15.38:44138) 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.773+0000 7f0949eda640 1 -- 172.21.15.38:0/826992397 learned_addr learned my addr 172.21.15.38:0/826992397 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.774+0000 7f0939ffb640 10 client.?.objecter ms_handle_connect 0x7f0944140b30 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.774+0000 7f0939ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.774+0000 7f0939ffb640 10 client.?.objecter ms_handle_connect 0x7f09440b5bb0 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.774+0000 7f0939ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.774+0000 7f0939ffb640 10 client.?.objecter ms_handle_connect 0x7f09440b57d0 2024-04-15T15:24:55.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.774+0000 7f0939ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:55.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307946252 0 0) 0x7f0944139830 con 0x7f09440b57d0 2024-04-15T15:24:55.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): my global_id is 32266 2024-04-15T15:24:55.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0928004eb0 con 0x7f09440b57d0 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985044791 0 0) 0x7f09440ade70 con 0x7f09440b5bb0 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): my global_id is 81017 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0944139830 con 0x7f09440b5bb0 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215932869 0 0) 0x7f09440adc00 con 0x7f0944140b30 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 10 monclient(hunting): my global_id is 33549 2024-04-15T15:24:55.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.776+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09440ade70 con 0x7f0944140b30 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3930046058 0 0) 0x7f0944139830 con 0x7f09440b5bb0 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09440adc00 con 0x7f09440b5bb0 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f09340018b0 con 0x7f09440b5bb0 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 10 monclient(hunting): dump: 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.785 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1853666638 0 0) 0x7f0928004eb0 con 0x7f09440b57d0 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0944139830 con 0x7f09440b57d0 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f09400018b0 con 0x7f09440b57d0 2024-04-15T15:24:55.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.780+0000 7f0939ffb640 10 monclient(hunting): dump: 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.781+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1521613919 0 0) 0x7f09440ade70 con 0x7f0944140b30 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.781+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0928004eb0 con 0x7f0944140b30 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.781+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f093c001f40 con 0x7f0944140b30 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.781+0000 7f0939ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.781+0000 7f0939ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.781+0000 7f0939ffb640 10 monclient(hunting): dump: 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:55.788 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:55.789 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:55.789 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:55.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2965688112 0 0) 0x7f09440adc00 con 0x7f09440b5bb0 2024-04-15T15:24:55.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 >> v1:172.21.15.164:6789/0 conn(0x7f09440b57d0 legacy=0x7f09441d87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 >> v1:172.21.15.38:6789/0 conn(0x7f0944140b30 legacy=0x7f0944139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:55.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 10 monclient: _finish_hunting 0 2024-04-15T15:24:55.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 1 monclient: found mon.c 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0944146350 con 0x7f09440b5bb0 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 10 monclient: _finish_auth 0 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f0939ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f094b93d640 5 monclient: authenticate success, global_id 81017 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f094b93d640 10 monclient: _renew_subs 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f094b93d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0944142fc0 con 0x7f09440b5bb0 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f094b93d640 10 client.81017.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f094b93d640 10 monclient: _renew_subs 2024-04-15T15:24:55.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f094b93d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:24:55.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f09441d90c0 con 0x7f09440b5bb0 2024-04-15T15:24:55.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.784+0000 7f094b93d640 1 librados: init done 2024-04-15T15:24:55.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.785+0000 7f094b93d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:55.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.785+0000 7f094b93d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:55.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.785+0000 7f094b93d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:24:55.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:55.785+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0944077050 con 0x7f09440b5bb0 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.061+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0934003610 con 0x7f09440b5bb0 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.061+0000 7f0939ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.061+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0934003960 con 0x7f09440b5bb0 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.061+0000 7f0939ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.061+0000 7f0939ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.061+0000 7f0939ffb640 10 monclient: dump: 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.063 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:56.064 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:56.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.061+0000 7f093b7fe640 4 set_mon_vals no callback set 2024-04-15T15:24:56.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.062+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f0934019e90 con 0x7f09440b5bb0 2024-04-15T15:24:56.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.063+0000 7f09496d9640 10 monclient: get_auth_request con 0x7f092806ef20 auth_method 0 2024-04-15T15:24:56.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.063+0000 7f0939ffb640 10 client.81017.objecter ms_handle_connect 0x7f092806ef20 2024-04-15T15:24:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.067+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(995..995 src has 501..995) ==== 5226+0+0 (unknown 354831944 0 0) 0x7f09340520b0 con 0x7f09440b5bb0 2024-04-15T15:24:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.067+0000 7f0939ffb640 10 client.81017.objecter ms_dispatch 0x7f0944000b90 osd_map(995..995 src has 501..995) 2024-04-15T15:24:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.067+0000 7f0939ffb640 3 client.81017.objecter handle_osd_map got epochs [995,995] > 0 2024-04-15T15:24:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.067+0000 7f0939ffb640 3 client.81017.objecter handle_osd_map decoding full epoch 995 2024-04-15T15:24:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.068+0000 7f0939ffb640 20 client.81017.objecter dump_active .. 0 homeless 2024-04-15T15:24:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.068+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f09340544b0 con 0x7f09440b5bb0 2024-04-15T15:24:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.068+0000 7f0939ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:56.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.068+0000 7f0939ffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:24:56.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.272+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0944068f70 con 0x7f092806ef20 2024-04-15T15:24:56.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.275+0000 7f0939ffb640 1 -- 172.21.15.38:0/826992397 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+116281 (unknown 2965378022 0 3358038367) 0x7f0944068f70 con 0x7f092806ef20 2024-04-15T15:24:56.277 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T15:24:56.278 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-15T15:24:56.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 10 librados: watch_flush enter 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 10 librados: watch_flush exit 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 20 client.81017.objecter shutdown clearing up homeless session... 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 10 client.81017.objecter successfully canceled tick 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 >> v1:172.21.15.38:6800/1608957829 conn(0x7f092806ef20 legacy=0x7f09280713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 10 monclient: shutdown 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 >> v1:172.21.15.38:6790/0 conn(0x7f09440b5bb0 legacy=0x7f0944138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 shutdown_connections 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 >> 172.21.15.38:0/826992397 conn(0x7f0944067790 msgr2=0x7f0944146c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 shutdown_connections 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 1 -- 172.21.15.38:0/826992397 wait complete. 2024-04-15T15:24:56.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.277+0000 7f094b93d640 1 librados: shutdown 2024-04-15T15:24:56.290 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1758,"stamp":"2024-04-15T15:24:55.185095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":609876,"kb_used_data":59152,"kb_used_omap":12,"kb_used_meta":550579,"kb_avail":754364844,"statfs":{"total":773094113280,"available":772469600256,"internally_reserved":0,"allocated":60571648,"data_stored":28724887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":563793457},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":552,"apply_latency_ms":552,"commit_latency_ns":552000000,"apply_latency_ns":552000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4000309,"num_objects":-45,"num_object_clones":-1,"num_object_copies":-135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-45,"num_whiteouts":0,"num_read":-30,"num_read_kb":-10,"num_write":-70,"num_write_kb":-3969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":-1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.429142"},"pg_stats":[{"pgid":"16.0","version":"0'0","reported_seq":1886,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.761965+0000","last_change":"2024-04-15T15:01:50.438639+0000","last_active":"2024-04-15T15:24:52.761965+0000","last_peered":"2024-04-15T15:24:52.761965+0000","last_clean":"2024-04-15T15:24:52.761965+0000","last_became_active":"2024-04-15T15:01:50.426257+0000","last_became_peered":"2024-04-15T15:01:50.426257+0000","last_unstale":"2024-04-15T15:24:52.761965+0000","last_undegraded":"2024-04-15T15:24:52.761965+0000","last_fullsized":"2024-04-15T15:24:52.761965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:32:49.021840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1","version":"50'7","reported_seq":1907,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.749423+0000","last_change":"2024-04-15T15:01:58.061052+0000","last_active":"2024-04-15T15:24:52.749423+0000","last_peered":"2024-04-15T15:24:52.749423+0000","last_clean":"2024-04-15T15:24:52.749423+0000","last_became_active":"2024-04-15T15:01:58.055451+0000","last_became_peered":"2024-04-15T15:01:58.055451+0000","last_unstale":"2024-04-15T15:24:52.749423+0000","last_undegraded":"2024-04-15T15:24:52.749423+0000","last_fullsized":"2024-04-15T15:24:52.749423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:21:09.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1847,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.718058+0000","last_change":"2024-04-15T15:01:50.838864+0000","last_active":"2024-04-15T15:24:49.718058+0000","last_peered":"2024-04-15T15:24:49.718058+0000","last_clean":"2024-04-15T15:24:49.718058+0000","last_became_active":"2024-04-15T15:01:50.831566+0000","last_became_peered":"2024-04-15T15:01:50.831566+0000","last_unstale":"2024-04-15T15:24:49.718058+0000","last_undegraded":"2024-04-15T15:24:49.718058+0000","last_fullsized":"2024-04-15T15:24:49.718058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:16:57.027776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1874,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.058944+0000","last_change":"2024-04-15T15:01:37.314165+0000","last_active":"2024-04-15T15:24:51.058944+0000","last_peered":"2024-04-15T15:24:51.058944+0000","last_clean":"2024-04-15T15:24:51.058944+0000","last_became_active":"2024-04-15T15:01:37.307442+0000","last_became_peered":"2024-04-15T15:01:37.307442+0000","last_unstale":"2024-04-15T15:24:51.058944+0000","last_undegraded":"2024-04-15T15:24:51.058944+0000","last_fullsized":"2024-04-15T15:24:51.058944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:53:10.058304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.895591+0000","last_change":"2024-04-15T15:01:59.509650+0000","last_active":"2024-04-15T15:24:50.895591+0000","last_peered":"2024-04-15T15:24:50.895591+0000","last_clean":"2024-04-15T15:24:50.895591+0000","last_became_active":"2024-04-15T15:01:59.386200+0000","last_became_peered":"2024-04-15T15:01:59.386200+0000","last_unstale":"2024-04-15T15:24:50.895591+0000","last_undegraded":"2024-04-15T15:24:50.895591+0000","last_fullsized":"2024-04-15T15:24:50.895591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:48:58.277123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.830171+0000","last_change":"2024-04-15T15:01:59.531768+0000","last_active":"2024-04-15T15:24:50.830171+0000","last_peered":"2024-04-15T15:24:50.830171+0000","last_clean":"2024-04-15T15:24:50.830171+0000","last_became_active":"2024-04-15T15:01:59.475519+0000","last_became_peered":"2024-04-15T15:01:59.475519+0000","last_unstale":"2024-04-15T15:24:50.830171+0000","last_undegraded":"2024-04-15T15:24:50.830171+0000","last_fullsized":"2024-04-15T15:24:50.830171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:03:14.693476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1864,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.933158+0000","last_change":"2024-04-15T15:02:06.546089+0000","last_active":"2024-04-15T15:24:49.933158+0000","last_peered":"2024-04-15T15:24:49.933158+0000","last_clean":"2024-04-15T15:24:49.933158+0000","last_became_active":"2024-04-15T15:02:06.539897+0000","last_became_peered":"2024-04-15T15:02:06.539897+0000","last_unstale":"2024-04-15T15:24:49.933158+0000","last_undegraded":"2024-04-15T15:24:49.933158+0000","last_fullsized":"2024-04-15T15:24:49.933158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:37:56.830252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1845,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.744451+0000","last_change":"2024-04-15T15:01:56.856132+0000","last_active":"2024-04-15T15:24:49.744451+0000","last_peered":"2024-04-15T15:24:49.744451+0000","last_clean":"2024-04-15T15:24:49.744451+0000","last_became_active":"2024-04-15T15:01:56.846541+0000","last_became_peered":"2024-04-15T15:01:56.846541+0000","last_unstale":"2024-04-15T15:24:49.744451+0000","last_undegraded":"2024-04-15T15:24:49.744451+0000","last_fullsized":"2024-04-15T15:24:49.744451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:11:40.534644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1895,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.033567+0000","last_change":"2024-04-15T15:01:31.031846+0000","last_active":"2024-04-15T15:24:51.033567+0000","last_peered":"2024-04-15T15:24:51.033567+0000","last_clean":"2024-04-15T15:24:51.033567+0000","last_became_active":"2024-04-15T15:01:31.025154+0000","last_became_peered":"2024-04-15T15:01:31.025154+0000","last_unstale":"2024-04-15T15:24:51.033567+0000","last_undegraded":"2024-04-15T15:24:51.033567+0000","last_fullsized":"2024-04-15T15:24:51.033567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:58.719678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1872,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.019777+0000","last_change":"2024-04-15T15:01:47.686569+0000","last_active":"2024-04-15T15:24:51.019777+0000","last_peered":"2024-04-15T15:24:51.019777+0000","last_clean":"2024-04-15T15:24:51.019777+0000","last_became_active":"2024-04-15T15:01:47.652436+0000","last_became_peered":"2024-04-15T15:01:47.652436+0000","last_unstale":"2024-04-15T15:24:51.019777+0000","last_undegraded":"2024-04-15T15:24:51.019777+0000","last_fullsized":"2024-04-15T15:24:51.019777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:56:25.406881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1892,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.758941+0000","last_change":"2024-04-15T15:01:58.212389+0000","last_active":"2024-04-15T15:24:52.758941+0000","last_peered":"2024-04-15T15:24:52.758941+0000","last_clean":"2024-04-15T15:24:52.758941+0000","last_became_active":"2024-04-15T15:01:58.198421+0000","last_became_peered":"2024-04-15T15:01:58.198421+0000","last_unstale":"2024-04-15T15:24:52.758941+0000","last_undegraded":"2024-04-15T15:24:52.758941+0000","last_fullsized":"2024-04-15T15:24:52.758941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:07:05.883431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1878,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.675075+0000","last_change":"2024-04-15T15:01:58.537678+0000","last_active":"2024-04-15T15:24:49.675075+0000","last_peered":"2024-04-15T15:24:49.675075+0000","last_clean":"2024-04-15T15:24:49.675075+0000","last_became_active":"2024-04-15T15:01:58.520219+0000","last_became_peered":"2024-04-15T15:01:58.520219+0000","last_unstale":"2024-04-15T15:24:49.675075+0000","last_undegraded":"2024-04-15T15:24:49.675075+0000","last_fullsized":"2024-04-15T15:24:49.675075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:14:29.432422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1869,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.880251+0000","last_change":"2024-04-15T15:01:48.968180+0000","last_active":"2024-04-15T15:24:49.880251+0000","last_peered":"2024-04-15T15:24:49.880251+0000","last_clean":"2024-04-15T15:24:49.880251+0000","last_became_active":"2024-04-15T15:01:48.927422+0000","last_became_peered":"2024-04-15T15:01:48.927422+0000","last_unstale":"2024-04-15T15:24:49.880251+0000","last_undegraded":"2024-04-15T15:24:49.880251+0000","last_fullsized":"2024-04-15T15:24:49.880251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:03:54.276935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"23'76","reported_seq":2024,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.724026+0000","last_change":"2024-04-15T14:59:45.003334+0000","last_active":"2024-04-15T15:24:49.724026+0000","last_peered":"2024-04-15T15:24:49.724026+0000","last_clean":"2024-04-15T15:24:49.724026+0000","last_became_active":"2024-04-15T14:59:44.414489+0000","last_became_peered":"2024-04-15T14:59:44.414489+0000","last_unstale":"2024-04-15T15:24:49.724026+0000","last_undegraded":"2024-04-15T15:24:49.724026+0000","last_fullsized":"2024-04-15T15:24:49.724026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:36.273099+0000","last_clean_scrub_stamp":"2024-04-15T14:59:36.273099+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:03.807751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1888,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.061620+0000","last_change":"2024-04-15T14:59:53.285621+0000","last_active":"2024-04-15T15:24:51.061620+0000","last_peered":"2024-04-15T15:24:51.061620+0000","last_clean":"2024-04-15T15:24:51.061620+0000","last_became_active":"2024-04-15T14:59:53.276305+0000","last_became_peered":"2024-04-15T14:59:53.276305+0000","last_unstale":"2024-04-15T15:24:51.061620+0000","last_undegraded":"2024-04-15T15:24:51.061620+0000","last_fullsized":"2024-04-15T15:24:51.061620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:22:32.578057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1880,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.714070+0000","last_change":"2024-04-15T15:01:50.074053+0000","last_active":"2024-04-15T15:24:49.714070+0000","last_peered":"2024-04-15T15:24:49.714070+0000","last_clean":"2024-04-15T15:24:49.714070+0000","last_became_active":"2024-04-15T15:01:50.052081+0000","last_became_peered":"2024-04-15T15:01:50.052081+0000","last_unstale":"2024-04-15T15:24:49.714070+0000","last_undegraded":"2024-04-15T15:24:49.714070+0000","last_fullsized":"2024-04-15T15:24:49.714070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:30:25.217264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1889,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.068419+0000","last_change":"2024-04-15T14:59:52.944781+0000","last_active":"2024-04-15T15:24:51.068419+0000","last_peered":"2024-04-15T15:24:51.068419+0000","last_clean":"2024-04-15T15:24:51.068419+0000","last_became_active":"2024-04-15T14:59:52.908707+0000","last_became_peered":"2024-04-15T14:59:52.908707+0000","last_unstale":"2024-04-15T15:24:51.068419+0000","last_undegraded":"2024-04-15T15:24:51.068419+0000","last_fullsized":"2024-04-15T15:24:51.068419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:51:14.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1894,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.074283+0000","last_change":"2024-04-15T15:01:38.091528+0000","last_active":"2024-04-15T15:24:51.074283+0000","last_peered":"2024-04-15T15:24:51.074283+0000","last_clean":"2024-04-15T15:24:51.074283+0000","last_became_active":"2024-04-15T15:01:37.900280+0000","last_became_peered":"2024-04-15T15:01:37.900280+0000","last_unstale":"2024-04-15T15:24:51.074283+0000","last_undegraded":"2024-04-15T15:24:51.074283+0000","last_fullsized":"2024-04-15T15:24:51.074283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:41.178094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1907,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.059219+0000","last_change":"2024-04-15T14:59:52.865828+0000","last_active":"2024-04-15T15:24:51.059219+0000","last_peered":"2024-04-15T15:24:51.059219+0000","last_clean":"2024-04-15T15:24:51.059219+0000","last_became_active":"2024-04-15T14:59:52.828831+0000","last_became_peered":"2024-04-15T14:59:52.828831+0000","last_unstale":"2024-04-15T15:24:51.059219+0000","last_undegraded":"2024-04-15T15:24:51.059219+0000","last_fullsized":"2024-04-15T15:24:51.059219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:49:13.712376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1893,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.763694+0000","last_change":"2024-04-15T15:01:57.832637+0000","last_active":"2024-04-15T15:24:52.763694+0000","last_peered":"2024-04-15T15:24:52.763694+0000","last_clean":"2024-04-15T15:24:52.763694+0000","last_became_active":"2024-04-15T15:01:57.822039+0000","last_became_peered":"2024-04-15T15:01:57.822039+0000","last_unstale":"2024-04-15T15:24:52.763694+0000","last_undegraded":"2024-04-15T15:24:52.763694+0000","last_fullsized":"2024-04-15T15:24:52.763694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:36:46.591238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1889,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.023774+0000","last_change":"2024-04-15T14:59:53.222610+0000","last_active":"2024-04-15T15:24:51.023774+0000","last_peered":"2024-04-15T15:24:51.023774+0000","last_clean":"2024-04-15T15:24:51.023774+0000","last_became_active":"2024-04-15T14:59:53.217062+0000","last_became_peered":"2024-04-15T14:59:53.217062+0000","last_unstale":"2024-04-15T15:24:51.023774+0000","last_undegraded":"2024-04-15T15:24:51.023774+0000","last_fullsized":"2024-04-15T15:24:51.023774+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:15.523606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1892,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.125515+0000","last_change":"2024-04-15T15:01:44.637457+0000","last_active":"2024-04-15T15:24:51.125515+0000","last_peered":"2024-04-15T15:24:51.125515+0000","last_clean":"2024-04-15T15:24:51.125515+0000","last_became_active":"2024-04-15T15:01:44.538256+0000","last_became_peered":"2024-04-15T15:01:44.538256+0000","last_unstale":"2024-04-15T15:24:51.125515+0000","last_undegraded":"2024-04-15T15:24:51.125515+0000","last_fullsized":"2024-04-15T15:24:51.125515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:29:56.488170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1897,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.783476+0000","last_change":"2024-04-15T14:59:53.268620+0000","last_active":"2024-04-15T15:24:52.783476+0000","last_peered":"2024-04-15T15:24:52.783476+0000","last_clean":"2024-04-15T15:24:52.783476+0000","last_became_active":"2024-04-15T14:59:53.236225+0000","last_became_peered":"2024-04-15T14:59:53.236225+0000","last_unstale":"2024-04-15T15:24:52.783476+0000","last_undegraded":"2024-04-15T15:24:52.783476+0000","last_fullsized":"2024-04-15T15:24:52.783476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:02:24.955207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1877,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.844122+0000","last_change":"2024-04-15T15:01:59.581889+0000","last_active":"2024-04-15T15:24:50.844122+0000","last_peered":"2024-04-15T15:24:50.844122+0000","last_clean":"2024-04-15T15:24:50.844122+0000","last_became_active":"2024-04-15T15:01:59.575852+0000","last_became_peered":"2024-04-15T15:01:59.575852+0000","last_unstale":"2024-04-15T15:24:50.844122+0000","last_undegraded":"2024-04-15T15:24:50.844122+0000","last_fullsized":"2024-04-15T15:24:50.844122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:13:33.644867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1888,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.157899+0000","last_change":"2024-04-15T14:59:53.006767+0000","last_active":"2024-04-15T15:24:51.157899+0000","last_peered":"2024-04-15T15:24:51.157899+0000","last_clean":"2024-04-15T15:24:51.157899+0000","last_became_active":"2024-04-15T14:59:53.001226+0000","last_became_peered":"2024-04-15T14:59:53.001226+0000","last_unstale":"2024-04-15T15:24:51.157899+0000","last_undegraded":"2024-04-15T15:24:51.157899+0000","last_fullsized":"2024-04-15T15:24:51.157899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:24:19.402932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.899463+0000","last_change":"2024-04-15T15:01:53.665706+0000","last_active":"2024-04-15T15:24:50.899463+0000","last_peered":"2024-04-15T15:24:50.899463+0000","last_clean":"2024-04-15T15:24:50.899463+0000","last_became_active":"2024-04-15T15:01:53.660325+0000","last_became_peered":"2024-04-15T15:01:53.660325+0000","last_unstale":"2024-04-15T15:24:50.899463+0000","last_undegraded":"2024-04-15T15:24:50.899463+0000","last_fullsized":"2024-04-15T15:24:50.899463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:05:10.873866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1903,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.912217+0000","last_change":"2024-04-15T14:59:53.351131+0000","last_active":"2024-04-15T15:24:50.912217+0000","last_peered":"2024-04-15T15:24:50.912217+0000","last_clean":"2024-04-15T15:24:50.912217+0000","last_became_active":"2024-04-15T14:59:53.319031+0000","last_became_peered":"2024-04-15T14:59:53.319031+0000","last_unstale":"2024-04-15T15:24:50.912217+0000","last_undegraded":"2024-04-15T15:24:50.912217+0000","last_fullsized":"2024-04-15T15:24:50.912217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:02:06.831069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1894,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.097686+0000","last_change":"2024-04-15T15:01:36.591333+0000","last_active":"2024-04-15T15:24:51.097686+0000","last_peered":"2024-04-15T15:24:51.097686+0000","last_clean":"2024-04-15T15:24:51.097686+0000","last_became_active":"2024-04-15T15:01:36.581212+0000","last_became_peered":"2024-04-15T15:01:36.581212+0000","last_unstale":"2024-04-15T15:24:51.097686+0000","last_undegraded":"2024-04-15T15:24:51.097686+0000","last_fullsized":"2024-04-15T15:24:51.097686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:25:08.293854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1886,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.142521+0000","last_change":"2024-04-15T14:59:53.315692+0000","last_active":"2024-04-15T15:24:51.142521+0000","last_peered":"2024-04-15T15:24:51.142521+0000","last_clean":"2024-04-15T15:24:51.142521+0000","last_became_active":"2024-04-15T14:59:53.310268+0000","last_became_peered":"2024-04-15T14:59:53.310268+0000","last_unstale":"2024-04-15T15:24:51.142521+0000","last_undegraded":"2024-04-15T15:24:51.142521+0000","last_fullsized":"2024-04-15T15:24:51.142521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:16:52.167819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1878,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.879815+0000","last_change":"2024-04-15T15:01:53.629947+0000","last_active":"2024-04-15T15:24:50.879815+0000","last_peered":"2024-04-15T15:24:50.879815+0000","last_clean":"2024-04-15T15:24:50.879815+0000","last_became_active":"2024-04-15T15:01:53.609717+0000","last_became_peered":"2024-04-15T15:01:53.609717+0000","last_unstale":"2024-04-15T15:24:50.879815+0000","last_undegraded":"2024-04-15T15:24:50.879815+0000","last_fullsized":"2024-04-15T15:24:50.879815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:32:01.075020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1873,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.110863+0000","last_change":"2024-04-15T15:01:42.779951+0000","last_active":"2024-04-15T15:24:51.110863+0000","last_peered":"2024-04-15T15:24:51.110863+0000","last_clean":"2024-04-15T15:24:51.110863+0000","last_became_active":"2024-04-15T15:01:42.774408+0000","last_became_peered":"2024-04-15T15:01:42.774408+0000","last_unstale":"2024-04-15T15:24:51.110863+0000","last_undegraded":"2024-04-15T15:24:51.110863+0000","last_fullsized":"2024-04-15T15:24:51.110863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:05.785898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1880,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.903335+0000","last_change":"2024-04-15T15:01:58.212111+0000","last_active":"2024-04-15T15:24:50.903335+0000","last_peered":"2024-04-15T15:24:50.903335+0000","last_clean":"2024-04-15T15:24:50.903335+0000","last_became_active":"2024-04-15T15:01:58.202626+0000","last_became_peered":"2024-04-15T15:01:58.202626+0000","last_unstale":"2024-04-15T15:24:50.903335+0000","last_undegraded":"2024-04-15T15:24:50.903335+0000","last_fullsized":"2024-04-15T15:24:50.903335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:06.026358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1880,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.891363+0000","last_change":"2024-04-15T15:01:54.211646+0000","last_active":"2024-04-15T15:24:50.891363+0000","last_peered":"2024-04-15T15:24:50.891363+0000","last_clean":"2024-04-15T15:24:50.891363+0000","last_became_active":"2024-04-15T15:01:54.206258+0000","last_became_peered":"2024-04-15T15:01:54.206258+0000","last_unstale":"2024-04-15T15:24:50.891363+0000","last_undegraded":"2024-04-15T15:24:50.891363+0000","last_fullsized":"2024-04-15T15:24:50.891363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:10:44.038067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1895,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.070662+0000","last_change":"2024-04-15T15:01:43.288156+0000","last_active":"2024-04-15T15:24:51.070662+0000","last_peered":"2024-04-15T15:24:51.070662+0000","last_clean":"2024-04-15T15:24:51.070662+0000","last_became_active":"2024-04-15T15:01:43.261603+0000","last_became_peered":"2024-04-15T15:01:43.261603+0000","last_unstale":"2024-04-15T15:24:51.070662+0000","last_undegraded":"2024-04-15T15:24:51.070662+0000","last_fullsized":"2024-04-15T15:24:51.070662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:24:52.000881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1893,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.757022+0000","last_change":"2024-04-15T15:01:58.020146+0000","last_active":"2024-04-15T15:24:52.757022+0000","last_peered":"2024-04-15T15:24:52.757022+0000","last_clean":"2024-04-15T15:24:52.757022+0000","last_became_active":"2024-04-15T15:01:58.007306+0000","last_became_peered":"2024-04-15T15:01:58.007306+0000","last_unstale":"2024-04-15T15:24:52.757022+0000","last_undegraded":"2024-04-15T15:24:52.757022+0000","last_fullsized":"2024-04-15T15:24:52.757022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:51:31.200321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1879,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:50.854726+0000","last_change":"2024-04-15T15:01:53.764775+0000","last_active":"2024-04-15T15:24:50.854726+0000","last_peered":"2024-04-15T15:24:50.854726+0000","last_clean":"2024-04-15T15:24:50.854726+0000","last_became_active":"2024-04-15T15:01:53.747318+0000","last_became_peered":"2024-04-15T15:01:53.747318+0000","last_unstale":"2024-04-15T15:24:50.854726+0000","last_undegraded":"2024-04-15T15:24:50.854726+0000","last_fullsized":"2024-04-15T15:24:50.854726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:26:07.121772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":989,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.066403+0000","last_change":"2024-04-15T15:11:58.160174+0000","last_active":"2024-04-15T15:24:51.066403+0000","last_peered":"2024-04-15T15:24:51.066403+0000","last_clean":"2024-04-15T15:24:51.066403+0000","last_became_active":"2024-04-15T15:11:58.147973+0000","last_became_peered":"2024-04-15T15:11:58.147973+0000","last_unstale":"2024-04-15T15:24:51.066403+0000","last_undegraded":"2024-04-15T15:24:51.066403+0000","last_fullsized":"2024-04-15T15:24:51.066403+0000","mapping_epoch":488,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":489,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:41:39.100310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1883,"reported_epoch":994,"state":"active+clean","last_fresh":"2024-04-15T15:24:52.780310+0000","last_change":"2024-04-15T15:01:50.350153+0000","last_active":"2024-04-15T15:24:52.780310+0000","last_peered":"2024-04-15T15:24:52.780310+0000","last_clean":"2024-04-15T15:24:52.780310+0000","last_became_active":"2024-04-15T15:01:50.337533+0000","last_became_peered":"2024-04-15T15:01:50.337533+0000","last_unstale":"2024-04-15T15:24:52.780310+0000","last_undegraded":"2024-04-15T15:24:52.780310+0000","last_fullsized":"2024-04-15T15:24:52.780310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:13:36.423971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1892,"reported_epoch":992,"state":"active+clean","last_fresh":"2024-04-15T15:24:51.123543+0000","last_change":"2024-04-15T15:01:38.478868+0000","last_active":"2024-04-15T15:24:51.123543+0000","last_peered":"2024-04-15T15:24:51.123543+0000","last_clean":"2024-04-15T15:24:51.123543+0000","last_became_active":"2024-04-15T15:01:38.420878+0000","last_became_peered":"2024-04-15T15:01:38.420878+0000","last_unstale":"2024-04-15T15:24:51.123543+0000","last_undegraded":"2024-04-15T15:24:51.123543+0000","last_fullsized":"2024-04-15T15:24:51.123543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:10.994698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1856,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.703271+0000","last_change":"2024-04-15T15:01:41.056228+0000","last_active":"2024-04-15T15:24:49.703271+0000","last_peered":"2024-04-15T15:24:49.703271+0000","last_clean":"2024-04-15T15:24:49.703271+0000","last_became_active":"2024-04-15T15:01:40.945764+0000","last_became_peered":"2024-04-15T15:01:40.945764+0000","last_unstale":"2024-04-15T15:24:49.703271+0000","last_undegraded":"2024-04-15T15:24:49.703271+0000","last_fullsized":"2024-04-15T15:24:49.703271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:50:25.275328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1857,"reported_epoch":991,"state":"active+clean","last_fresh":"2024-04-15T15:24:49.715419+0000","last_change":"2024-04-15T15:01:38.387944+0000","last_active":"2024-04-15T15:24:49.715419+0000","last_peered":"2024-04-15T15:24:49.715419+0000","last_clean":"2024-04-15T15:24:49.715419+0000","last_became_active":"2024-04-15T15:01:37.967524+0000","last_became_peered":"2024-04-15T15:01:37.967524+0000","last_unstale":"2024-04-15T15:24:49.715419+0000","last_undegraded":"2024-04-15T15:24:49.715419+0000","last_fullsized":"2024-04-15T15:24:49.715419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:31:23.864691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":2,"up_from":24,"seq":103079215407,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82860,"kb_used_data":7260,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288980,"statfs":{"total":96636764160,"available":96551915520,"internally_reserved":0,"allocated":7434240,"data_stored":3468022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784248111,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82896,"kb_used_data":7300,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288944,"statfs":{"total":96636764160,"available":96551878656,"internally_reserved":0,"allocated":7475200,"data_stored":3494056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":100,"apply_latency_ms":100,"commit_latency_ns":100000000,"apply_latency_ns":100000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313522,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70548,"kb_used_data":7424,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301292,"statfs":{"total":96636764160,"available":96564523008,"internally_reserved":0,"allocated":7602176,"data_stored":3621032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":89,"apply_latency_ms":89,"commit_latency_ns":89000000,"apply_latency_ns":89000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313519,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70800,"kb_used_data":7680,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301040,"statfs":{"total":96636764160,"available":96564264960,"internally_reserved":0,"allocated":7864320,"data_stored":3863091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":88,"apply_latency_ms":88,"commit_latency_ns":88000000,"apply_latency_ns":88000000},"alerts":[]},{"osd":4,"up_from":20,"seq":85899346223,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70388,"kb_used_data":7268,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301452,"statfs":{"total":96636764160,"available":96564686848,"internally_reserved":0,"allocated":7442432,"data_stored":3470993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":80,"apply_latency_ms":80,"commit_latency_ns":80000000,"apply_latency_ns":80000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477039,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74968,"kb_used_data":7684,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296872,"statfs":{"total":96636764160,"available":96559996928,"internally_reserved":0,"allocated":7868416,"data_stored":3889318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477039,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82856,"kb_used_data":7256,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288984,"statfs":{"total":96636764160,"available":96551919616,"internally_reserved":0,"allocated":7430144,"data_stored":3458705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575154,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74560,"kb_used_data":7280,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94297280,"statfs":{"total":96636764160,"available":96560414720,"internally_reserved":0,"allocated":7454720,"data_stored":3459670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:24:56.291 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.394+0000 7f883df55640 10 monclient: get_monmap_and_config 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.394+0000 7f883df55640 10 monclient: build_initial_monmap 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.394+0000 7f883df55640 10 monclient: monmap: 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:24:56.395492+0000 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:24:56.395492+0000 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:56.396 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:24:56.397 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:24:56.397 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.395+0000 7f883df55640 1 Processor -- start 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.395+0000 7f883df55640 1 -- start start 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.395+0000 7f883df55640 10 monclient: init 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 10 monclient(hunting): picked mon.noname-b con 0x7f883806bf40 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 10 monclient(hunting): picked mon.noname-c con 0x7f8838147370 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 10 monclient(hunting): picked mon.noname-a con 0x7f88380b10f0 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88380af0f0 con 0x7f88380b10f0 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f883806cd70 con 0x7f8838147370 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f883806d1c0 con 0x7f883806bf40 2024-04-15T15:24:56.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f883df55640 10 monclient(hunting): authenticate will time out at 2956.666593s 2024-04-15T15:24:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f88377fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f883806bf40 0x7f8838146c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56006/0 (socket says 172.21.15.38:56006) 2024-04-15T15:24:56.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.396+0000 7f88377fe640 1 -- 172.21.15.38:0/1586563683 learned_addr learned my addr 172.21.15.38:0/1586563683 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182809374 0 0) 0x7f883806cd70 con 0x7f8838147370 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): my global_id is 32269 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8820003520 con 0x7f8838147370 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1454603908 0 0) 0x7f883806d1c0 con 0x7f883806bf40 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): my global_id is 81020 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f883806cd70 con 0x7f883806bf40 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046242015 0 0) 0x7f88380af0f0 con 0x7f88380b10f0 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:56.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 10 monclient(hunting): my global_id is 33552 2024-04-15T15:24:56.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.399+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f883806d1c0 con 0x7f88380b10f0 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 730938961 0 0) 0x7f8820003520 con 0x7f8838147370 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 >> v1:172.21.15.38:6790/0 conn(0x7f883806bf40 legacy=0x7f8838146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 >> v1:172.21.15.38:6789/0 conn(0x7f88380b10f0 legacy=0x7f883814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 10 monclient: _finish_hunting 0 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 1 monclient: found mon.noname-c 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88380b15f0 con 0x7f8838147370 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 10 monclient: _finish_auth 0 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 10 monclient: _check_auth_tickets 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f882c001610 con 0x7f8838147370 2024-04-15T15:24:56.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f88367fc640 10 monclient: dump: 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f883df55640 5 monclient: authenticate success, global_id 32269 2024-04-15T15:24:56.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.402+0000 7f883df55640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.404+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f882c001870 con 0x7f8838147370 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.404+0000 7f88367fc640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.404+0000 7f88367fc640 1 -- 172.21.15.38:0/1586563683 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f882c001c40 con 0x7f8838147370 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.404+0000 7f88367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.404+0000 7f88367fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.404+0000 7f88367fc640 10 monclient: dump: 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.407 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.404+0000 7f883df55640 10 monclient: get_monmap_and_config success 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.404+0000 7f883df55640 4 set_mon_vals no callback set 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.405+0000 7f883df55640 10 monclient: shutdown 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.405+0000 7f883df55640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.405+0000 7f883df55640 1 -- 172.21.15.38:0/1586563683 >> v1:172.21.15.164:6789/0 conn(0x7f8838147370 legacy=0x7f88380b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.405+0000 7f883df55640 1 -- 172.21.15.38:0/1586563683 shutdown_connections 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.405+0000 7f883df55640 1 -- 172.21.15.38:0/1586563683 >> 172.21.15.38:0/1586563683 conn(0x7f88380b6bf0 msgr2=0x7f88380b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.405+0000 7f883df55640 1 -- 172.21.15.38:0/1586563683 shutdown_connections 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.405+0000 7f883df55640 1 -- 172.21.15.38:0/1586563683 wait complete. 2024-04-15T15:24:56.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.406+0000 7f883df55640 10 monclient: build_initial_monmap 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.406+0000 7f883df55640 10 monclient: monmap: 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.406+0000 7f883df55640 1 librados: starting msgr at 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.406+0000 7f883df55640 1 librados: starting objecter 2024-04-15T15:24:56.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.406+0000 7f883df55640 1 Processor -- start 2024-04-15T15:24:56.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.406+0000 7f883df55640 1 -- start start 2024-04-15T15:24:56.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.406+0000 7f883df55640 1 librados: setting wanted keys 2024-04-15T15:24:56.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.406+0000 7f883df55640 1 librados: calling monclient init 2024-04-15T15:24:56.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.406+0000 7f883df55640 10 monclient: init 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 10 monclient(hunting): picked mon.noname-a con 0x7f883806bf40 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 10 monclient(hunting): picked mon.noname-b con 0x7f88380b10f0 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 10 monclient(hunting): picked mon.noname-c con 0x7f8838147370 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8838142a90 con 0x7f883806bf40 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8838142c60 con 0x7f88380b10f0 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f883813e8a0 con 0x7f8838147370 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f883df55640 10 monclient(hunting): authenticate will time out at 2956.677683s 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f88377fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f883806bf40 0x7f88381390f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44166/0 (socket says 172.21.15.38:44166) 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.407+0000 7f88377fe640 1 -- 172.21.15.38:0/2758032428 learned_addr learned my addr 172.21.15.38:0/2758032428 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.408+0000 7f881ffff640 10 client.?.objecter ms_handle_connect 0x7f8838147370 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.408+0000 7f881ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.408+0000 7f881ffff640 10 client.?.objecter ms_handle_connect 0x7f883806bf40 2024-04-15T15:24:56.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.408+0000 7f881ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.408+0000 7f881ffff640 10 client.?.objecter ms_handle_connect 0x7f88380b10f0 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.408+0000 7f881ffff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.409+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964523656 0 0) 0x7f8838142c60 con 0x7f88380b10f0 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.409+0000 7f881ffff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.409+0000 7f881ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.409+0000 7f881ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.409+0000 7f881ffff640 10 monclient(hunting): my global_id is 32272 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.409+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8824004eb0 con 0x7f88380b10f0 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264979223 0 0) 0x7f883813e8a0 con 0x7f8838147370 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 10 monclient(hunting): my global_id is 81023 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8838142c60 con 0x7f8838147370 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481747466 0 0) 0x7f8838142a90 con 0x7f883806bf40 2024-04-15T15:24:56.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 10 monclient(hunting): my global_id is 33555 2024-04-15T15:24:56.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.410+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f883813e8a0 con 0x7f883806bf40 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.414+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2408246633 0 0) 0x7f8824004eb0 con 0x7f88380b10f0 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.414+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8838142a90 con 0x7f88380b10f0 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.414+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f882c001bc0 con 0x7f88380b10f0 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.414+0000 7f881ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.414+0000 7f881ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.414+0000 7f881ffff640 10 monclient(hunting): dump: 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:56.417 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.414+0000 7f881ffff640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1528472928 0 0) 0x7f8838142c60 con 0x7f8838147370 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8824004eb0 con 0x7f8838147370 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f8830001c30 con 0x7f8838147370 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 10 monclient(hunting): dump: 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.418 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1966406321 0 0) 0x7f883813e8a0 con 0x7f883806bf40 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8838142c60 con 0x7f883806bf40 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f88280018b0 con 0x7f883806bf40 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.415+0000 7f881ffff640 10 monclient(hunting): dump: 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.419 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:56.420 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:56.420 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:56.420 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:56.420 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:56.420 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2505751696 0 0) 0x7f8838142a90 con 0x7f88380b10f0 2024-04-15T15:24:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 >> v1:172.21.15.38:6790/0 conn(0x7f8838147370 legacy=0x7f88381d91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 >> v1:172.21.15.38:6789/0 conn(0x7f883806bf40 legacy=0x7f88381390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 10 monclient: _finish_hunting 0 2024-04-15T15:24:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 1 monclient: found mon.b 2024-04-15T15:24:56.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883813ea70 con 0x7f88380b10f0 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 10 monclient: _finish_auth 0 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 10 monclient: _check_auth_tickets 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f881ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f883df55640 5 monclient: authenticate success, global_id 32272 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f883df55640 10 monclient: _renew_subs 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f883df55640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8838139800 con 0x7f88380b10f0 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f883df55640 10 client.32272.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f883df55640 10 monclient: _renew_subs 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f883df55640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:56.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8838142fe0 con 0x7f88380b10f0 2024-04-15T15:24:56.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.418+0000 7f883df55640 1 librados: init done 2024-04-15T15:24:56.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.419+0000 7f883df55640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:56.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.419+0000 7f883df55640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:56.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.419+0000 7f883df55640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:56.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.419+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88380b04e0 con 0x7f88380b10f0 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.433+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f882c001870 con 0x7f88380b10f0 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.433+0000 7f881ffff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.433+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f882c0038a0 con 0x7f88380b10f0 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.433+0000 7f881ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.433+0000 7f881ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.433+0000 7f881ffff640 10 monclient: dump: 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:56.435 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:56.436 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.433+0000 7f8835ffb640 4 set_mon_vals no callback set 2024-04-15T15:24:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.434+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f882c019dd0 con 0x7f88380b10f0 2024-04-15T15:24:56.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.435+0000 7f88377fe640 10 monclient: get_auth_request con 0x7f882406ef20 auth_method 0 2024-04-15T15:24:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.435+0000 7f881ffff640 10 client.32272.objecter ms_handle_connect 0x7f882406ef20 2024-04-15T15:24:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.436+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(995..995 src has 501..995) ==== 5226+0+0 (unknown 354831944 0 0) 0x7f882c051f30 con 0x7f88380b10f0 2024-04-15T15:24:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.436+0000 7f881ffff640 10 client.32272.objecter ms_dispatch 0x7f8838000b90 osd_map(995..995 src has 501..995) 2024-04-15T15:24:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.436+0000 7f881ffff640 3 client.32272.objecter handle_osd_map got epochs [995,995] > 0 2024-04-15T15:24:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.436+0000 7f881ffff640 3 client.32272.objecter handle_osd_map decoding full epoch 995 2024-04-15T15:24:56.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.436+0000 7f881ffff640 20 client.32272.objecter dump_active .. 0 homeless 2024-04-15T15:24:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.678+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f88380b04e0 con 0x7f88380b10f0 2024-04-15T15:24:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.678+0000 7f881ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.678+0000 7f881ffff640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:24:56.888 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:34.731 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:56.894 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:34.737 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:56.919 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:34.762 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:56.953 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:34.743 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:56.956 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:34.747 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:56.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.967+0000 7f883df55640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-15T15:24:56.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.967+0000 7f883df55640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T15:24:56.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.967+0000 7f883df55640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:56.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:56.967+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8838077050 con 0x7f88380b10f0 2024-04-15T15:24:56.969 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:34.812 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:56.970 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:34.813 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:57.003 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:34.847 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:57.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.009+0000 7f881ffff640 1 -- 172.21.15.38:0/2758032428 <== mon.1 v1:172.21.15.164:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v996) ==== 74+0+15807 (unknown 3389677508 0 3242584859) 0x7f882c054330 con 0x7f88380b10f0 2024-04-15T15:24:57.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.009+0000 7f881ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-15T15:24:57.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.009+0000 7f881ffff640 10 monclient: _finish_command 2 = system:0 2024-04-15T15:24:57.011 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T15:24:57.011 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":996,"fsid":"faa113cf-e8b3-4b6c-9186-1faf4aadaf02","created":"2024-04-15T14:58:48.695643+0000","modified":"2024-04-15T15:24:56.671738+0000","last_up_change":"2024-04-15T14:59:46.146485+0000","last_in_change":"2024-04-15T14:58:53.843518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":106,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":341,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T14:59:35.434715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T14:59:51.069858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-04-15T15:01:20.163844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b870e9a9-3e1d-42c1-ba76-36b1ee5978ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":990,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6805","nonce":3048929997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6807","nonce":3048929997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6810","nonce":3048929997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6808","nonce":3048929997}]},"public_addr":"172.21.15.38:6805/3048929997","cluster_addr":"172.21.15.38:6807/3048929997","heartbeat_back_addr":"172.21.15.38:6810/3048929997","heartbeat_front_addr":"172.21.15.38:6808/3048929997","state":["exists","up"]},{"osd":1,"uuid":"e06df806-60c1-44b4-bbd4-4f95ab1396c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":990,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6806","nonce":3103013511}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6809","nonce":3103013511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6812","nonce":3103013511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6811","nonce":3103013511}]},"public_addr":"172.21.15.38:6806/3103013511","cluster_addr":"172.21.15.38:6809/3103013511","heartbeat_back_addr":"172.21.15.38:6812/3103013511","heartbeat_front_addr":"172.21.15.38:6811/3103013511","state":["exists","up"]},{"osd":2,"uuid":"f4979136-ad43-4de0-ada7-929d6dc5b167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":986,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6801","nonce":2505059545}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6802","nonce":2505059545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6804","nonce":2505059545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6803","nonce":2505059545}]},"public_addr":"172.21.15.38:6801/2505059545","cluster_addr":"172.21.15.38:6802/2505059545","heartbeat_back_addr":"172.21.15.38:6804/2505059545","heartbeat_front_addr":"172.21.15.38:6803/2505059545","state":["exists","up"]},{"osd":3,"uuid":"593776e0-1477-4717-9384-4a59876dea6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":990,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6813","nonce":2746933626}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6814","nonce":2746933626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6816","nonce":2746933626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.38:6815","nonce":2746933626}]},"public_addr":"172.21.15.38:6813/2746933626","cluster_addr":"172.21.15.38:6814/2746933626","heartbeat_back_addr":"172.21.15.38:6816/2746933626","heartbeat_front_addr":"172.21.15.38:6815/2746933626","state":["exists","up"]},{"osd":4,"uuid":"800a7901-9a0d-4b25-9ae4-1c5d71d12067","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":990,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6812","nonce":1135451953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6813","nonce":1135451953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6815","nonce":1135451953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6814","nonce":1135451953}]},"public_addr":"172.21.15.164:6812/1135451953","cluster_addr":"172.21.15.164:6813/1135451953","heartbeat_back_addr":"172.21.15.164:6815/1135451953","heartbeat_front_addr":"172.21.15.164:6814/1135451953","state":["exists","up"]},{"osd":5,"uuid":"7909b57b-d022-4039-9f42-e174c7dd0b74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":990,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6804","nonce":350713352}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6805","nonce":350713352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6807","nonce":350713352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6806","nonce":350713352}]},"public_addr":"172.21.15.164:6804/350713352","cluster_addr":"172.21.15.164:6805/350713352","heartbeat_back_addr":"172.21.15.164:6807/350713352","heartbeat_front_addr":"172.21.15.164:6806/350713352","state":["exists","up"]},{"osd":6,"uuid":"990d8572-67b1-4e7e-87fd-924316d04870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":990,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6808","nonce":3078148286}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6809","nonce":3078148286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6811","nonce":3078148286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6810","nonce":3078148286}]},"public_addr":"172.21.15.164:6808/3078148286","cluster_addr":"172.21.15.164:6809/3078148286","heartbeat_back_addr":"172.21.15.164:6811/3078148286","heartbeat_front_addr":"172.21.15.164:6810/3078148286","state":["exists","up"]},{"osd":7,"uuid":"8a80ef70-3374-4016-97d0-79db87381bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":990,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6800","nonce":3353977755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6801","nonce":3353977755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6803","nonce":3353977755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.164:6802","nonce":3353977755}]},"public_addr":"172.21.15.164:6800/3353977755","cluster_addr":"172.21.15.164:6801/3353977755","heartbeat_back_addr":"172.21.15.164:6803/3353977755","heartbeat_front_addr":"172.21.15.164:6802/3353977755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.779245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.754228+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.720273+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:32.101812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:30.038226+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:30.010400+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.842035+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T14:59:29.987364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.8","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":3,"length":2}]},{"pool":19,"snaps":[{"begin":5,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":1}]},{"pool":76,"snaps":[{"begin":1,"length":1}]},{"pool":98,"snaps":[{"begin":7,"length":2}]},{"pool":108,"snaps":[{"begin":1,"length":1}]},{"pool":114,"snaps":[{"begin":1,"length":2}]},{"pool":123,"snaps":[{"begin":2,"length":3}]},{"pool":134,"snaps":[{"begin":3,"length":1}]},{"pool":147,"snaps":[{"begin":2,"length":2}]},{"pool":150,"snaps":[{"begin":2,"length":1},{"begin":4,"length":2}]},{"pool":157,"snaps":[{"begin":2,"length":3}]},{"pool":170,"snaps":[{"begin":2,"length":2}]},{"pool":188,"snaps":[{"begin":2,"length":1}]},{"pool":193,"snaps":[{"begin":3,"length":2}]},{"pool":208,"snaps":[{"begin":4,"length":4}]},{"pool":250,"snaps":[{"begin":7,"length":1}]},{"pool":263,"snaps":[{"begin":8,"length":1}]},{"pool":268,"snaps":[{"begin":10,"length":1}]},{"pool":271,"snaps":[{"begin":11,"length":2}]},{"pool":279,"snaps":[{"begin":14,"length":1}]},{"pool":322,"snaps":[{"begin":2,"length":1}]},{"pool":323,"snaps":[{"begin":3,"length":1}]},{"pool":326,"snaps":[{"begin":4,"length":1}]},{"pool":330,"snaps":[{"begin":6,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T15:24:57.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 10 librados: watch_flush enter 2024-04-15T15:24:57.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 10 librados: watch_flush exit 2024-04-15T15:24:57.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 20 client.32272.objecter shutdown clearing up homeless session... 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 10 client.32272.objecter successfully canceled tick 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 >> v1:172.21.15.38:6800/1608957829 conn(0x7f882406ef20 legacy=0x7f88240713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 10 monclient: shutdown 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 >> v1:172.21.15.164:6789/0 conn(0x7f88380b10f0 legacy=0x7f88381d8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 shutdown_connections 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.012+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 >> 172.21.15.38:0/2758032428 conn(0x7f88380b6bf0 msgr2=0x7f88380af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.013+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 shutdown_connections 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.013+0000 7f883df55640 1 -- 172.21.15.38:0/2758032428 wait complete. 2024-04-15T15:24:57.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:57.013+0000 7f883df55640 1 librados: shutdown 2024-04-15T15:24:57.021 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:34.811 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:24:58.030 INFO:tasks.ceph:Scrubbing osd.0 2024-04-15T15:24:58.030 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:24:58.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.137+0000 7f1de7cc8640 10 monclient: get_monmap_and_config 2024-04-15T15:24:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.137+0000 7f1de7cc8640 10 monclient: build_initial_monmap 2024-04-15T15:24:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.137+0000 7f1de7cc8640 10 monclient: monmap: 2024-04-15T15:24:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:24:58.138333+0000 2024-04-15T15:24:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:24:58.138333+0000 2024-04-15T15:24:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.139 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:58.140 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:24:58.140 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:24:58.140 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.138+0000 7f1de7cc8640 1 Processor -- start 2024-04-15T15:24:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.138+0000 7f1de7cc8640 1 -- start start 2024-04-15T15:24:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.138+0000 7f1de7cc8640 10 monclient: init 2024-04-15T15:24:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.138+0000 7f1de7cc8640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:58.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.138+0000 7f1de7cc8640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.138+0000 7f1de7cc8640 10 monclient(hunting): picked mon.noname-b con 0x7f1de0075640 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de7cc8640 10 monclient(hunting): picked mon.noname-c con 0x7f1de00b1040 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de7cc8640 10 monclient(hunting): picked mon.noname-a con 0x7f1de0146e00 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de7cc8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de006f460 con 0x7f1de0146e00 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de7cc8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de0070460 con 0x7f1de00b1040 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de7cc8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de0070740 con 0x7f1de0075640 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de7cc8640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de7cc8640 10 monclient(hunting): authenticate will time out at 2958.409499s 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de5a64640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f1de0075640 0x7f1de01404a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56020/0 (socket says 172.21.15.38:56020) 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de5a64640 1 -- 172.21.15.38:0/1030794423 learned_addr learned my addr 172.21.15.38:0/1030794423 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:58.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.139+0000 7f1de6265640 1 --1- 172.21.15.38:0/1030794423 >> v1:172.21.15.38:6789/0 conn(0x7f1de0146e00 0x7f1de014e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44182/0 (socket says 172.21.15.38:44182) 2024-04-15T15:24:58.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1824331395 0 0) 0x7f1de0070460 con 0x7f1de00b1040 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): my global_id is 32275 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dcc003520 con 0x7f1de00b1040 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224280442 0 0) 0x7f1de0070740 con 0x7f1de0075640 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): my global_id is 81026 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1de0070460 con 0x7f1de0075640 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632433676 0 0) 0x7f1de006f460 con 0x7f1de0146e00 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 10 monclient(hunting): my global_id is 33558 2024-04-15T15:24:58.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.142+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1de0070740 con 0x7f1de0146e00 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 175660482 0 0) 0x7f1dcc003520 con 0x7f1de00b1040 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 >> v1:172.21.15.38:6790/0 conn(0x7f1de0075640 legacy=0x7f1de01404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 >> v1:172.21.15.38:6789/0 conn(0x7f1de0146e00 legacy=0x7f1de014e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 10 monclient: _finish_hunting 0 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 1 monclient: found mon.noname-c 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de006f700 con 0x7f1de00b1040 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 10 monclient: _finish_auth 0 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 10 monclient: _check_auth_tickets 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:58.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f1dd0001610 con 0x7f1de00b1040 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de4a62640 10 monclient: dump: 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de7cc8640 5 monclient: authenticate success, global_id 32275 2024-04-15T15:24:58.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.145+0000 7f1de7cc8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1dd0001870 con 0x7f1de00b1040 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de4a62640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de4a62640 1 -- 172.21.15.38:0/1030794423 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f1dd0001c40 con 0x7f1de00b1040 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de4a62640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de4a62640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de4a62640 10 monclient: dump: 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de7cc8640 10 monclient: get_monmap_and_config success 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de7cc8640 4 set_mon_vals no callback set 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de7cc8640 10 monclient: shutdown 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de7cc8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.147+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1030794423 >> v1:172.21.15.164:6789/0 conn(0x7f1de00b1040 legacy=0x7f1de01466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.148+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1030794423 shutdown_connections 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.148+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1030794423 >> 172.21.15.38:0/1030794423 conn(0x7f1de00b5490 msgr2=0x7f1de00b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.148+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1030794423 shutdown_connections 2024-04-15T15:24:58.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.148+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1030794423 wait complete. 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.148+0000 7f1de7cc8640 10 monclient: build_initial_monmap 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.148+0000 7f1de7cc8640 10 monclient: monmap: 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 1 librados: starting msgr at 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 1 librados: starting objecter 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 1 Processor -- start 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 1 -- start start 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 1 librados: setting wanted keys 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 1 librados: calling monclient init 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 10 monclient: init 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 10 monclient(hunting): picked mon.noname-c con 0x7f1de0075640 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 10 monclient(hunting): picked mon.noname-a con 0x7f1de00b1040 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 10 monclient(hunting): picked mon.noname-b con 0x7f1de0146e00 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de0138ed0 con 0x7f1de00b1040 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de01391b0 con 0x7f1de0146e00 2024-04-15T15:24:58.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de0139490 con 0x7f1de0075640 2024-04-15T15:24:58.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:58.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.149+0000 7f1de7cc8640 10 monclient(hunting): authenticate will time out at 2958.420129s 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.150+0000 7f1de5a64640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f1de0075640 0x7f1de01379d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56026/0 (socket says 172.21.15.38:56026) 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.150+0000 7f1de5a64640 1 -- 172.21.15.38:0/1281076497 learned_addr learned my addr 172.21.15.38:0/1281076497 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.150+0000 7f1dd67fc640 10 client.?.objecter ms_handle_connect 0x7f1de0146e00 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.150+0000 7f1dd67fc640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.150+0000 7f1dd67fc640 10 client.?.objecter ms_handle_connect 0x7f1de0075640 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.150+0000 7f1dd67fc640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.150+0000 7f1dd67fc640 10 client.?.objecter ms_handle_connect 0x7f1de00b1040 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.150+0000 7f1dd67fc640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.151+0000 7f1de5a64640 1 -- 172.21.15.38:0/1281076497 >> v1:172.21.15.38:6790/0 conn(0x7f1de0075640 legacy=0x7f1de01379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.151+0000 7f1de5a64640 1 -- 172.21.15.38:0/1281076497 >> v1:172.21.15.38:6790/0 conn(0x7f1de0075640 legacy=0x7f1de01379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-15T15:24:58.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.151+0000 7f1de5a64640 1 --1- 172.21.15.38:0/1281076497 >> v1:172.21.15.38:6790/0 conn(0x7f1de0075640 0x7f1de01379d0 :-1 s=OPENED pgs=10251 cs=1 l=1).handle_message read tag failed 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.151+0000 7f1de5a64640 1 --1- 172.21.15.38:0/1281076497 >> v1:172.21.15.38:6790/0 conn(0x7f1de0075640 0x7f1de01379d0 :-1 s=OPENED pgs=10251 cs=1 l=1).fault on lossy channel, failing 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.151+0000 7f1dd67fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.38:6790/0 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516296621 0 0) 0x7f1de01391b0 con 0x7f1de0146e00 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 10 monclient(hunting): my global_id is 32278 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dc4004eb0 con 0x7f1de0146e00 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877274452 0 0) 0x7f1de0138ed0 con 0x7f1de00b1040 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 10 monclient(hunting): my global_id is 33561 2024-04-15T15:24:58.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.152+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1de01391b0 con 0x7f1de00b1040 2024-04-15T15:24:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.156+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 209474737 0 0) 0x7f1dc4004eb0 con 0x7f1de0146e00 2024-04-15T15:24:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.156+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1de0138ed0 con 0x7f1de0146e00 2024-04-15T15:24:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.156+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f1dd8001c30 con 0x7f1de0146e00 2024-04-15T15:24:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.156+0000 7f1dd67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.156+0000 7f1dd67fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:24:58.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.156+0000 7f1dd67fc640 10 monclient(hunting): dump: 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.156+0000 7f1dd67fc640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.157+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 348369154 0 0) 0x7f1de01391b0 con 0x7f1de00b1040 2024-04-15T15:24:58.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.157+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1dc4004eb0 con 0x7f1de00b1040 2024-04-15T15:24:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.157+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f1dd0001bc0 con 0x7f1de00b1040 2024-04-15T15:24:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.157+0000 7f1dd67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.157+0000 7f1dd67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:24:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.157+0000 7f1dd67fc640 10 monclient(hunting): dump: 2024-04-15T15:24:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.160 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.161 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.161 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 912525881 0 0) 0x7f1de0138ed0 con 0x7f1de0146e00 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 >> v1:172.21.15.38:6790/0 conn(0x7f1de0075640 legacy=0x7f1de01379d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 >> v1:172.21.15.38:6789/0 conn(0x7f1de00b1040 legacy=0x7f1de01e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 10 monclient: _finish_hunting 0 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 1 monclient: found mon.b 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de0136e30 con 0x7f1de0146e00 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 10 monclient: _finish_auth 0 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 10 monclient: _check_auth_tickets 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1dd67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:58.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1de7cc8640 5 monclient: authenticate success, global_id 32278 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1de7cc8640 10 monclient: _renew_subs 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1de7cc8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1de013a060 con 0x7f1de0146e00 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1de7cc8640 10 client.32278.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1de7cc8640 10 monclient: _renew_subs 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1de7cc8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1de0139a90 con 0x7f1de0146e00 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.160+0000 7f1de7cc8640 1 librados: init done 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.161+0000 7f1de7cc8640 10 client.32278.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.161+0000 7f1de7cc8640 15 client.32278.objecter _session_command_op_assign -1 1 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.161+0000 7f1de7cc8640 20 client.32278.objecter _get_session osd=-1 returning homeless 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.161+0000 7f1de7cc8640 10 client.32278.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.161+0000 7f1de7cc8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:58.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.161+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f1de0077050 con 0x7f1de0146e00 2024-04-15T15:24:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.178+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1de0077050 con 0x7f1de0146e00 2024-04-15T15:24:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.178+0000 7f1dd67fc640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.178+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f1dd8004d00 con 0x7f1de0146e00 2024-04-15T15:24:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.178+0000 7f1dd67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.178+0000 7f1dd67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.178+0000 7f1dd67fc640 10 monclient: dump: 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.178+0000 7f1dd7fff640 4 set_mon_vals no callback set 2024-04-15T15:24:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.179+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f1dd801b230 con 0x7f1de0146e00 2024-04-15T15:24:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.180+0000 7f1de5a64640 10 monclient: get_auth_request con 0x7f1dc406ed40 auth_method 0 2024-04-15T15:24:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.180+0000 7f1dd67fc640 10 client.32278.objecter ms_handle_connect 0x7f1dc406ed40 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7f1dd8053540 con 0x7f1de0146e00 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 10 client.32278.objecter ms_dispatch 0x7f1de0000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 3 client.32278.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 3 client.32278.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 10 client.32278.objecter checking command 1 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 20 client.32278.objecter _get_session s=0x7f1dc4077070 osd=0 3 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 20 client.32278.objecter put_session s=0x7f1dc4077070 osd=0 3 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 15 client.32278.objecter _session_command_op_remove -1 1 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 20 client.32278.objecter _get_session s=0x7f1dc4077070 osd=0 3 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 20 client.32278.objecter get_session s=0x7f1dc4077070 osd=0 3 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 15 client.32278.objecter _session_command_op_assign 0 1 2024-04-15T15:24:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 20 client.32278.objecter put_session s=0x7f1dc4077070 osd=0 4 2024-04-15T15:24:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 10 client.32278.objecter _send_command 1 2024-04-15T15:24:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.38:6805/3048929997 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dc407b390 con 0x7f1dc4077720 2024-04-15T15:24:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 20 client.32278.objecter dump_active .. 0 homeless 2024-04-15T15:24:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=996) ==== 24+0+0 (unknown 3060284901 0 0) 0x7f1dd8051450 con 0x7f1de0146e00 2024-04-15T15:24:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.181+0000 7f1dd67fc640 10 monclient: handle_get_version_reply finishing 1 version 996 2024-04-15T15:24:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.183+0000 7f1de5263640 10 monclient: get_auth_request con 0x7f1dc4077720 auth_method 0 2024-04-15T15:24:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.185+0000 7f1dd67fc640 10 client.32278.objecter ms_handle_connect 0x7f1dc4077720 2024-04-15T15:24:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.210+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== osd.0 v1:172.21.15.38:6805/3048929997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f1dc407b390 con 0x7f1dc4077720 2024-04-15T15:24:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.210+0000 7f1dd67fc640 10 client.32278.objecter ms_dispatch 0x7f1de0000b90 command_reply(tid 1: 0 ) 2024-04-15T15:24:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.210+0000 7f1dd67fc640 10 client.32278.objecter _finish_command 1 = system:0 2024-04-15T15:24:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.210+0000 7f1dd67fc640 20 client.32278.objecter put_session s=0x7f1dc4077070 osd=0 4 2024-04-15T15:24:58.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.210+0000 7f1dd67fc640 15 client.32278.objecter _session_command_op_remove 0 1 2024-04-15T15:24:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 10 client.32278.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-04-15T15:24:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 15 client.32278.objecter _session_command_op_assign -1 2 2024-04-15T15:24:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 20 client.32278.objecter _get_session s=0x7f1dc4077070 osd=0 3 2024-04-15T15:24:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 20 client.32278.objecter put_session s=0x7f1dc4077070 osd=0 3 2024-04-15T15:24:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 20 client.32278.objecter _get_session s=0x7f1dc4077070 osd=0 3 2024-04-15T15:24:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 15 client.32278.objecter _session_command_op_remove -1 2 2024-04-15T15:24:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 20 client.32278.objecter get_session s=0x7f1dc4077070 osd=0 3 2024-04-15T15:24:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 15 client.32278.objecter _session_command_op_assign 0 2 2024-04-15T15:24:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 20 client.32278.objecter put_session s=0x7f1dc4077070 osd=0 4 2024-04-15T15:24:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 10 client.32278.objecter _send_command 2 2024-04-15T15:24:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.223+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 --> v1:172.21.15.38:6805/3048929997 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1de00b4d90 con 0x7f1dc4077720 2024-04-15T15:24:58.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.236+0000 7f1dd67fc640 1 -- 172.21.15.38:0/1281076497 <== osd.0 v1:172.21.15.38:6805/3048929997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f1de00b4d90 con 0x7f1dc4077720 2024-04-15T15:24:58.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.236+0000 7f1dd67fc640 10 client.32278.objecter ms_dispatch 0x7f1de0000b90 command_reply(tid 2: 0 ) 2024-04-15T15:24:58.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.236+0000 7f1dd67fc640 10 client.32278.objecter _finish_command 2 = system:0 2024-04-15T15:24:58.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.236+0000 7f1dd67fc640 20 client.32278.objecter put_session s=0x7f1dc4077070 osd=0 4 2024-04-15T15:24:58.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.236+0000 7f1dd67fc640 15 client.32278.objecter _session_command_op_remove 0 2 2024-04-15T15:24:58.238 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-15T15:24:58.238 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:24:58.238 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.236+0000 7f1de7cc8640 10 librados: watch_flush enter 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 10 librados: watch_flush exit 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 10 client.32278.objecter close_session for osd.0 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 >> v1:172.21.15.38:6805/3048929997 conn(0x7f1dc4077720 legacy=0x7f1dc4079bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 20 client.32278.objecter put_session s=0x7f1dc4077070 osd=0 1 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 20 client.32278.objecter shutdown clearing up homeless session... 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 10 client.32278.objecter successfully canceled tick 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 >> v1:172.21.15.38:6800/1608957829 conn(0x7f1dc406ed40 legacy=0x7f1dc4071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 10 monclient: shutdown 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 >> v1:172.21.15.164:6789/0 conn(0x7f1de0146e00 legacy=0x7f1de01e3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de6265640 1 -- 172.21.15.38:0/1281076497 reap_dead start 2024-04-15T15:24:58.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 shutdown_connections 2024-04-15T15:24:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 >> 172.21.15.38:0/1281076497 conn(0x7f1de00b5490 msgr2=0x7f1de00b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 shutdown_connections 2024-04-15T15:24:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 1 -- 172.21.15.38:0/1281076497 wait complete. 2024-04-15T15:24:58.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.237+0000 7f1de7cc8640 1 librados: shutdown 2024-04-15T15:24:58.248 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-15T15:24:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.351+0000 7fc6d6adb640 10 monclient: get_monmap_and_config 2024-04-15T15:24:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.351+0000 7fc6d6adb640 10 monclient: build_initial_monmap 2024-04-15T15:24:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.351+0000 7fc6d6adb640 10 monclient: monmap: 2024-04-15T15:24:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:24:58.352706+0000 2024-04-15T15:24:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:24:58.352706+0000 2024-04-15T15:24:58.353 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:58.354 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.354 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:58.354 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:24:58.354 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:24:58.354 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.352+0000 7fc6d6adb640 1 Processor -- start 2024-04-15T15:24:58.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.352+0000 7fc6d6adb640 1 -- start start 2024-04-15T15:24:58.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.352+0000 7fc6d6adb640 10 monclient: init 2024-04-15T15:24:58.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:58.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 10 monclient(hunting): picked mon.noname-b con 0x7fc6d00b57d0 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 10 monclient(hunting): picked mon.noname-a con 0x7fc6d00b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 10 monclient(hunting): picked mon.noname-c con 0x7fc6d0140b30 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d0146e10 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d00aa840 con 0x7fc6d0140b30 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d00aa460 con 0x7fc6d00b57d0 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d6adb640 10 monclient(hunting): authenticate will time out at 2958.623785s 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d4877640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fc6d00b57d0 0x7fc6d0146700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56040/0 (socket says 172.21.15.38:56040) 2024-04-15T15:24:58.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.353+0000 7fc6d4877640 1 -- 172.21.15.38:0/2325059199 learned_addr learned my addr 172.21.15.38:0/2325059199 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:58.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632305892 0 0) 0x7fc6d00aa840 con 0x7fc6d0140b30 2024-04-15T15:24:58.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): my global_id is 32281 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6bc003520 con 0x7fc6d0140b30 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059696692 0 0) 0x7fc6d0146e10 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): my global_id is 33564 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d00aa840 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31570354 0 0) 0x7fc6d00aa460 con 0x7fc6d00b57d0 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 10 monclient(hunting): my global_id is 81029 2024-04-15T15:24:58.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.356+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d0146e10 con 0x7fc6d00b57d0 2024-04-15T15:24:58.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3325361674 0 0) 0x7fc6d00aa840 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 >> v1:172.21.15.38:6790/0 conn(0x7fc6d00b57d0 legacy=0x7fc6d0146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 >> v1:172.21.15.164:6789/0 conn(0x7fc6d0140b30 legacy=0x7fc6d014ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 10 monclient: _finish_hunting 0 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 1 monclient: found mon.noname-a 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d00b2970 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 10 monclient: _finish_auth 0 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 10 monclient: _check_auth_tickets 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc6b80015f0 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T15:24:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6cf7fe640 10 monclient: dump: 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6d6adb640 5 monclient: authenticate success, global_id 33564 2024-04-15T15:24:58.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.359+0000 7fc6d6adb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6b8001850 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6cf7fe640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/2325059199 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc6b8001c60 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6cf7fe640 10 monclient: dump: 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6d6adb640 10 monclient: get_monmap_and_config success 2024-04-15T15:24:58.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6d6adb640 4 set_mon_vals no callback set 2024-04-15T15:24:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6d6adb640 10 monclient: shutdown 2024-04-15T15:24:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6d6adb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.365+0000 7fc6d6adb640 1 -- 172.21.15.38:0/2325059199 >> v1:172.21.15.38:6789/0 conn(0x7fc6d00b5bb0 legacy=0x7fc6d0140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.366+0000 7fc6d6adb640 1 -- 172.21.15.38:0/2325059199 shutdown_connections 2024-04-15T15:24:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.366+0000 7fc6d6adb640 1 -- 172.21.15.38:0/2325059199 >> 172.21.15.38:0/2325059199 conn(0x7fc6d0067790 msgr2=0x7fc6d0067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.366+0000 7fc6d6adb640 1 -- 172.21.15.38:0/2325059199 shutdown_connections 2024-04-15T15:24:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.366+0000 7fc6d6adb640 1 -- 172.21.15.38:0/2325059199 wait complete. 2024-04-15T15:24:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.366+0000 7fc6d6adb640 10 monclient: build_initial_monmap 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.366+0000 7fc6d6adb640 10 monclient: monmap: 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 1 librados: starting msgr at 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 1 librados: starting objecter 2024-04-15T15:24:58.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 1 Processor -- start 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 1 -- start start 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 1 librados: setting wanted keys 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 1 librados: calling monclient init 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 10 monclient: init 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 10 monclient(hunting): picked mon.noname-b con 0x7fc6d00b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 10 monclient(hunting): picked mon.noname-c con 0x7fc6d00b5bb0 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 10 monclient(hunting): picked mon.noname-a con 0x7fc6d0140b30 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.367+0000 7fc6d6adb640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d00ad2d0 con 0x7fc6d0140b30 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6d6adb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d00ad5b0 con 0x7fc6d00b57d0 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6d6adb640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d0145f00 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6d6adb640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:58.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6d6adb640 10 monclient(hunting): authenticate will time out at 2958.638432s 2024-04-15T15:24:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6d4877640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc6d00b57d0 0x7fc6d0145710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:52870/0 (socket says 172.21.15.38:52870) 2024-04-15T15:24:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6d4877640 1 -- 172.21.15.38:0/1919170966 learned_addr learned my addr 172.21.15.38:0/1919170966 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6cd7fa640 10 client.?.objecter ms_handle_connect 0x7fc6d00b57d0 2024-04-15T15:24:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6cd7fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6cd7fa640 10 client.?.objecter ms_handle_connect 0x7fc6d00b5bb0 2024-04-15T15:24:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.368+0000 7fc6cd7fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.371+0000 7fc6cd7fa640 10 client.?.objecter ms_handle_connect 0x7fc6d0140b30 2024-04-15T15:24:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.371+0000 7fc6cd7fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.426+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3066408566 0 0) 0x7fc6d00ad2d0 con 0x7fc6d0140b30 2024-04-15T15:24:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.426+0000 7fc6cd7fa640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.426+0000 7fc6cd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.426+0000 7fc6cd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.426+0000 7fc6cd7fa640 10 monclient(hunting): my global_id is 33567 2024-04-15T15:24:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.426+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6b0004eb0 con 0x7fc6d0140b30 2024-04-15T15:24:58.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.427+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876882842 0 0) 0x7fc6d00ad5b0 con 0x7fc6d00b57d0 2024-04-15T15:24:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.427+0000 7fc6cd7fa640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.427+0000 7fc6cd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.427+0000 7fc6cd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.427+0000 7fc6cd7fa640 10 monclient(hunting): my global_id is 32284 2024-04-15T15:24:58.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.427+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d00ad2d0 con 0x7fc6d00b57d0 2024-04-15T15:24:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.430+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078457022 0 0) 0x7fc6d0145f00 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.430+0000 7fc6cd7fa640 10 monclient(hunting): _negotiate 2024-04-15T15:24:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.430+0000 7fc6cd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.430+0000 7fc6cd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.430+0000 7fc6cd7fa640 10 monclient(hunting): my global_id is 81032 2024-04-15T15:24:58.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.430+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d00ad5b0 con 0x7fc6d00b5bb0 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.431+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2419495911 0 0) 0x7fc6d00ad2d0 con 0x7fc6d00b57d0 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.431+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6d0145f00 con 0x7fc6d00b57d0 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.431+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc6c0001c30 con 0x7fc6d00b57d0 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.431+0000 7fc6cd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.431+0000 7fc6cd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.431+0000 7fc6cd7fa640 10 monclient(hunting): dump: 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.433 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.434 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.434 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.434 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.434 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.431+0000 7fc6cd7fa640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:24:58.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.433+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2021324140 0 0) 0x7fc6b0004eb0 con 0x7fc6d0140b30 2024-04-15T15:24:58.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.433+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6d00ad2d0 con 0x7fc6d0140b30 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.433+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc6c80017d0 con 0x7fc6d0140b30 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.433+0000 7fc6cd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.433+0000 7fc6cd7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.433+0000 7fc6cd7fa640 10 monclient(hunting): dump: 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.435 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2571407669 0 0) 0x7fc6d0145f00 con 0x7fc6d00b57d0 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 >> v1:172.21.15.38:6790/0 conn(0x7fc6d00b5bb0 legacy=0x7fc6d01425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 >> v1:172.21.15.38:6789/0 conn(0x7fc6d0140b30 legacy=0x7fc6d01e2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 10 monclient: _finish_hunting 0 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 1 monclient: found mon.b 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d01450f0 con 0x7fc6d00b57d0 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 10 monclient: _finish_auth 0 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 10 monclient: _check_auth_tickets 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6cd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6d6adb640 5 monclient: authenticate success, global_id 32284 2024-04-15T15:24:58.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6d6adb640 10 monclient: _renew_subs 2024-04-15T15:24:58.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6d6adb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:58.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d0145380 con 0x7fc6d00b57d0 2024-04-15T15:24:58.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6d6adb640 10 client.32284.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:58.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6d6adb640 10 monclient: _renew_subs 2024-04-15T15:24:58.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6d6adb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:58.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc6d0142ec0 con 0x7fc6d00b57d0 2024-04-15T15:24:58.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.435+0000 7fc6d6adb640 1 librados: init done 2024-04-15T15:24:58.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.436+0000 7fc6d6adb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:58.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.436+0000 7fc6d6adb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:58.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.436+0000 7fc6d6adb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:58.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.436+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d01464b0 con 0x7fc6d00b57d0 2024-04-15T15:24:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.450+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6c0004b60 con 0x7fc6d00b57d0 2024-04-15T15:24:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.450+0000 7fc6cd7fa640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.450+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fc6c0004f30 con 0x7fc6d00b57d0 2024-04-15T15:24:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.450+0000 7fc6cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:58.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.450+0000 7fc6cd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.450+0000 7fc6cd7fa640 10 monclient: dump: 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:58.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.450+0000 7fc6ceffd640 4 set_mon_vals no callback set 2024-04-15T15:24:58.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.450+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fc6c00050d0 con 0x7fc6d00b57d0 2024-04-15T15:24:58.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.451+0000 7fc6cffff640 10 monclient: get_auth_request con 0x7fc6b006ee80 auth_method 0 2024-04-15T15:24:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.451+0000 7fc6cd7fa640 10 client.32284.objecter ms_handle_connect 0x7fc6b006ee80 2024-04-15T15:24:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.452+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7fc6c0053890 con 0x7fc6d00b57d0 2024-04-15T15:24:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.452+0000 7fc6cd7fa640 10 client.32284.objecter ms_dispatch 0x7fc6d0000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:24:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.452+0000 7fc6cd7fa640 3 client.32284.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:24:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.452+0000 7fc6cd7fa640 3 client.32284.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:24:58.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.452+0000 7fc6cd7fa640 20 client.32284.objecter dump_active .. 0 homeless 2024-04-15T15:24:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.688+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fc6d01464b0 con 0x7fc6d00b57d0 2024-04-15T15:24:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.688+0000 7fc6cd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:58.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.688+0000 7fc6cd7fa640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:24:58.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.874+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fc6d0077050 con 0x7fc6b006ee80 2024-04-15T15:24:58.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.875+0000 7fc6cd7fa640 1 -- 172.21.15.38:0/1919170966 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fc6d0077050 con 0x7fc6b006ee80 2024-04-15T15:24:58.876 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 0 to deep-scrub 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 10 librados: watch_flush enter 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 10 librados: watch_flush exit 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 20 client.32284.objecter shutdown clearing up homeless session... 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 10 client.32284.objecter successfully canceled tick 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 >> v1:172.21.15.38:6800/1608957829 conn(0x7fc6b006ee80 legacy=0x7fc6b0071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 10 monclient: shutdown 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 >> v1:172.21.15.164:6789/0 conn(0x7fc6d00b57d0 legacy=0x7fc6d0145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 shutdown_connections 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 >> 172.21.15.38:0/1919170966 conn(0x7fc6d0067790 msgr2=0x7fc6d0067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 shutdown_connections 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 1 -- 172.21.15.38:0/1919170966 wait complete. 2024-04-15T15:24:58.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.877+0000 7fc6d6adb640 1 librados: shutdown 2024-04-15T15:24:58.889 INFO:tasks.ceph:Scrubbing osd.1 2024-04-15T15:24:58.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:24:58.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.997+0000 7f05c37c8640 10 monclient: get_monmap_and_config 2024-04-15T15:24:58.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.997+0000 7f05c37c8640 10 monclient: build_initial_monmap 2024-04-15T15:24:58.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.997+0000 7f05c37c8640 10 monclient: monmap: 2024-04-15T15:24:58.999 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:24:58.998357+0000 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:24:58.998357+0000 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.998+0000 7f05c37c8640 1 Processor -- start 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.998+0000 7f05c37c8640 1 -- start start 2024-04-15T15:24:59.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.998+0000 7f05c37c8640 10 monclient: init 2024-04-15T15:24:59.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.998+0000 7f05c37c8640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:59.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.998+0000 7f05c37c8640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.998+0000 7f05c37c8640 10 monclient(hunting): picked mon.noname-c con 0x7f05bc0af660 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.998+0000 7f05c37c8640 10 monclient(hunting): picked mon.noname-b con 0x7f05bc0aede0 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.998+0000 7f05c37c8640 10 monclient(hunting): picked mon.noname-a con 0x7f05bc0ae210 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.998+0000 7f05c37c8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc0adb10 con 0x7f05bc0ae210 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.999+0000 7f05c37c8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc0ac7f0 con 0x7f05bc0af660 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.999+0000 7f05c37c8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc073640 con 0x7f05bc0aede0 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.999+0000 7f05c37c8640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.999+0000 7f05c37c8640 10 monclient(hunting): authenticate will time out at 2959.269439s 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.999+0000 7f05c1d65640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f05bc0ae210 0x7f05bc14b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44222/0 (socket says 172.21.15.38:44222) 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.999+0000 7f05c1d65640 1 -- 172.21.15.38:0/754434300 learned_addr learned my addr 172.21.15.38:0/754434300 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:59.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:58.999+0000 7f05c0d63640 1 --1- 172.21.15.38:0/754434300 >> v1:172.21.15.38:6790/0 conn(0x7f05bc0aede0 0x7f05bc0ab7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56048/0 (socket says 172.21.15.38:56048) 2024-04-15T15:24:59.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.001+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2583990049 0 0) 0x7f05bc0ac7f0 con 0x7f05bc0af660 2024-04-15T15:24:59.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.001+0000 7f05b3fff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.001+0000 7f05b3fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.001+0000 7f05b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.001+0000 7f05b3fff640 10 monclient(hunting): my global_id is 32287 2024-04-15T15:24:59.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a8003520 con 0x7f05bc0af660 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393491205 0 0) 0x7f05bc073640 con 0x7f05bc0aede0 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 10 monclient(hunting): my global_id is 81035 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05bc0ac7f0 con 0x7f05bc0aede0 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103253951 0 0) 0x7f05bc0adb10 con 0x7f05bc0ae210 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 10 monclient(hunting): my global_id is 33570 2024-04-15T15:24:59.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.002+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05bc073640 con 0x7f05bc0ae210 2024-04-15T15:24:59.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1053759193 0 0) 0x7f05a8003520 con 0x7f05bc0af660 2024-04-15T15:24:59.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 >> v1:172.21.15.38:6790/0 conn(0x7f05bc0aede0 legacy=0x7f05bc0ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 >> v1:172.21.15.38:6789/0 conn(0x7f05bc0ae210 legacy=0x7f05bc14b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 10 monclient: _finish_hunting 0 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 1 monclient: found mon.noname-c 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc0ae8c0 con 0x7f05bc0af660 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 10 monclient: _finish_auth 0 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 10 monclient: _check_auth_tickets 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05c37c8640 5 monclient: authenticate success, global_id 32287 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05c37c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f05b8001610 con 0x7f05bc0af660 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05b3fff640 10 monclient: dump: 2024-04-15T15:24:59.007 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.005+0000 7f05c37c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:59.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.006+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05b8001830 con 0x7f05bc0af660 2024-04-15T15:24:59.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.006+0000 7f05b3fff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:59.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.006+0000 7f05b3fff640 1 -- 172.21.15.38:0/754434300 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f05b8001c00 con 0x7f05bc0af660 2024-04-15T15:24:59.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.006+0000 7f05c37c8640 10 monclient: get_monmap_and_config success 2024-04-15T15:24:59.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.006+0000 7f05c37c8640 4 set_mon_vals no callback set 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.006+0000 7f05b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.006+0000 7f05b3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.006+0000 7f05b3fff640 10 monclient: dump: 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.007+0000 7f05c37c8640 10 monclient: shutdown 2024-04-15T15:24:59.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.007+0000 7f05c37c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.007+0000 7f05c37c8640 1 -- 172.21.15.38:0/754434300 >> v1:172.21.15.164:6789/0 conn(0x7f05bc0af660 legacy=0x7f05bc143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.007+0000 7f05c37c8640 1 -- 172.21.15.38:0/754434300 shutdown_connections 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.007+0000 7f05c37c8640 1 -- 172.21.15.38:0/754434300 >> 172.21.15.38:0/754434300 conn(0x7f05bc068070 msgr2=0x7f05bc0b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.007+0000 7f05c37c8640 1 -- 172.21.15.38:0/754434300 shutdown_connections 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.007+0000 7f05c37c8640 1 -- 172.21.15.38:0/754434300 wait complete. 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.008+0000 7f05c37c8640 10 monclient: build_initial_monmap 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.008+0000 7f05c37c8640 10 monclient: monmap: 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:59.013 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.008+0000 7f05c37c8640 1 librados: starting msgr at 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.008+0000 7f05c37c8640 1 librados: starting objecter 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.008+0000 7f05c37c8640 1 Processor -- start 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.008+0000 7f05c37c8640 1 -- start start 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.008+0000 7f05c37c8640 1 librados: setting wanted keys 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.008+0000 7f05c37c8640 1 librados: calling monclient init 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.008+0000 7f05c37c8640 10 monclient: init 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 10 monclient(hunting): picked mon.noname-c con 0x7f05bc0ae210 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 10 monclient(hunting): picked mon.noname-a con 0x7f05bc0aede0 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:59.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 10 monclient(hunting): picked mon.noname-b con 0x7f05bc0af660 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc13fae0 con 0x7f05bc0aede0 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc1384a0 con 0x7f05bc0af660 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc072700 con 0x7f05bc0ae210 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.009+0000 7f05c37c8640 10 monclient(hunting): authenticate will time out at 2959.279978s 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.010+0000 7f05c0d63640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f05bc0aede0 0x7f05bc139390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44236/0 (socket says 172.21.15.38:44236) 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.010+0000 7f05c0d63640 1 -- 172.21.15.38:0/2227471197 learned_addr learned my addr 172.21.15.38:0/2227471197 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.010+0000 7f05b1ffb640 10 client.?.objecter ms_handle_connect 0x7f05bc0aede0 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.010+0000 7f05b1ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.010+0000 7f05b1ffb640 10 client.?.objecter ms_handle_connect 0x7f05bc0ae210 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.010+0000 7f05b1ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.010+0000 7f05b1ffb640 10 client.?.objecter ms_handle_connect 0x7f05bc0af660 2024-04-15T15:24:59.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.010+0000 7f05b1ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:59.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544732991 0 0) 0x7f05bc1384a0 con 0x7f05bc0af660 2024-04-15T15:24:59.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): my global_id is 32290 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a0004eb0 con 0x7f05bc0af660 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2072017161 0 0) 0x7f05bc072700 con 0x7f05bc0ae210 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): my global_id is 81038 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05bc1384a0 con 0x7f05bc0ae210 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582230094 0 0) 0x7f05bc0ac7f0 con 0x7f05bc0aede0 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 10 monclient(hunting): my global_id is 33573 2024-04-15T15:24:59.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.012+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05bc072700 con 0x7f05bc0aede0 2024-04-15T15:24:59.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.016+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3496392217 0 0) 0x7f05a0004eb0 con 0x7f05bc0af660 2024-04-15T15:24:59.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.016+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05bc0ac7f0 con 0x7f05bc0af660 2024-04-15T15:24:59.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.016+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f05b4001bb0 con 0x7f05bc0af660 2024-04-15T15:24:59.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.016+0000 7f05b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:59.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.016+0000 7f05b1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:24:59.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.016+0000 7f05b1ffb640 10 monclient(hunting): dump: 2024-04-15T15:24:59.019 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.019 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.019 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.020 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.020 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.020 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.020 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.020 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.020 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.020 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.016+0000 7f05b1ffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1722893394 0 0) 0x7f05bc072700 con 0x7f05bc0aede0 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05a0004eb0 con 0x7f05bc0aede0 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f05ac0018b0 con 0x7f05bc0aede0 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 10 monclient(hunting): dump: 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.021 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2972341175 0 0) 0x7f05bc1384a0 con 0x7f05bc0ae210 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05bc072700 con 0x7f05bc0ae210 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f05b8001b80 con 0x7f05bc0ae210 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.017+0000 7f05b1ffb640 10 monclient(hunting): dump: 2024-04-15T15:24:59.022 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.023 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.023 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.023 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.023 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.023 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.023 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.023 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.023 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.023 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3991872294 0 0) 0x7f05bc0ac7f0 con 0x7f05bc0af660 2024-04-15T15:24:59.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 >> v1:172.21.15.38:6790/0 conn(0x7f05bc0ae210 legacy=0x7f05bc138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 >> v1:172.21.15.38:6789/0 conn(0x7f05bc0aede0 legacy=0x7f05bc139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 10 monclient: _finish_hunting 0 2024-04-15T15:24:59.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 1 monclient: found mon.b 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc13e650 con 0x7f05bc0af660 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 10 monclient: _finish_auth 0 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05c37c8640 5 monclient: authenticate success, global_id 32290 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05c37c8640 10 monclient: _renew_subs 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05c37c8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc13ea10 con 0x7f05bc0af660 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05c37c8640 10 client.32290.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05c37c8640 10 monclient: _renew_subs 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05c37c8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f05bc13deb0 con 0x7f05bc0af660 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.020+0000 7f05c37c8640 1 librados: init done 2024-04-15T15:24:59.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.021+0000 7f05c37c8640 10 client.32290.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:59.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.021+0000 7f05c37c8640 15 client.32290.objecter _session_command_op_assign -1 1 2024-04-15T15:24:59.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.021+0000 7f05c37c8640 20 client.32290.objecter _get_session osd=-1 returning homeless 2024-04-15T15:24:59.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.021+0000 7f05c37c8640 10 client.32290.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:59.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.021+0000 7f05c37c8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.021+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f05bc077050 con 0x7f05bc0af660 2024-04-15T15:24:59.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.036+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05bc077050 con 0x7f05bc0af660 2024-04-15T15:24:59.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.036+0000 7f05b1ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:59.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.036+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f05b4004b60 con 0x7f05bc0af660 2024-04-15T15:24:59.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.036+0000 7f05b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:59.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.036+0000 7f05b1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:59.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.036+0000 7f05b1ffb640 10 monclient: dump: 2024-04-15T15:24:59.039 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.039 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.039 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.040 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.040 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.040 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.040 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.040 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.040 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.040 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.036+0000 7f05b37fe640 4 set_mon_vals no callback set 2024-04-15T15:24:59.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.037+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f05b4004d40 con 0x7f05bc0af660 2024-04-15T15:24:59.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.038+0000 7f05c1564640 10 monclient: get_auth_request con 0x7f05a006ef70 auth_method 0 2024-04-15T15:24:59.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.038+0000 7f05b1ffb640 10 client.32290.objecter ms_handle_connect 0x7f05a006ef70 2024-04-15T15:24:59.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.038+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7f05b4053440 con 0x7f05bc0af660 2024-04-15T15:24:59.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.038+0000 7f05b1ffb640 10 client.32290.objecter ms_dispatch 0x7f05bc000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:24:59.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.038+0000 7f05b1ffb640 3 client.32290.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:24:59.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.038+0000 7f05b1ffb640 3 client.32290.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:24:59.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 10 client.32290.objecter checking command 1 2024-04-15T15:24:59.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 20 client.32290.objecter _get_session s=0x7f05a0077210 osd=1 3 2024-04-15T15:24:59.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 20 client.32290.objecter put_session s=0x7f05a0077210 osd=1 3 2024-04-15T15:24:59.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 15 client.32290.objecter _session_command_op_remove -1 1 2024-04-15T15:24:59.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 20 client.32290.objecter _get_session s=0x7f05a0077210 osd=1 3 2024-04-15T15:24:59.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 20 client.32290.objecter get_session s=0x7f05a0077210 osd=1 3 2024-04-15T15:24:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 15 client.32290.objecter _session_command_op_assign 1 1 2024-04-15T15:24:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 20 client.32290.objecter put_session s=0x7f05a0077210 osd=1 4 2024-04-15T15:24:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 10 client.32290.objecter _send_command 1 2024-04-15T15:24:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.38:6806/3103013511 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05a007b5d0 con 0x7f05a00778c0 2024-04-15T15:24:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 20 client.32290.objecter dump_active .. 0 homeless 2024-04-15T15:24:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=996) ==== 24+0+0 (unknown 3060284901 0 0) 0x7f05b4051350 con 0x7f05bc0af660 2024-04-15T15:24:59.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05b1ffb640 10 monclient: handle_get_version_reply finishing 1 version 996 2024-04-15T15:24:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.039+0000 7f05c0d63640 10 monclient: get_auth_request con 0x7f05a00778c0 auth_method 0 2024-04-15T15:24:59.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.040+0000 7f05b1ffb640 10 client.32290.objecter ms_handle_connect 0x7f05a00778c0 2024-04-15T15:24:59.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.065+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== osd.1 v1:172.21.15.38:6806/3103013511 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f05a007b5d0 con 0x7f05a00778c0 2024-04-15T15:24:59.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.065+0000 7f05b1ffb640 10 client.32290.objecter ms_dispatch 0x7f05bc000b90 command_reply(tid 1: 0 ) 2024-04-15T15:24:59.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.065+0000 7f05b1ffb640 10 client.32290.objecter _finish_command 1 = system:0 2024-04-15T15:24:59.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.065+0000 7f05b1ffb640 20 client.32290.objecter put_session s=0x7f05a0077210 osd=1 4 2024-04-15T15:24:59.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.065+0000 7f05b1ffb640 15 client.32290.objecter _session_command_op_remove 1 1 2024-04-15T15:24:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 10 client.32290.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-04-15T15:24:59.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 15 client.32290.objecter _session_command_op_assign -1 2 2024-04-15T15:24:59.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 20 client.32290.objecter _get_session s=0x7f05a0077210 osd=1 3 2024-04-15T15:24:59.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 20 client.32290.objecter put_session s=0x7f05a0077210 osd=1 3 2024-04-15T15:24:59.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 20 client.32290.objecter _get_session s=0x7f05a0077210 osd=1 3 2024-04-15T15:24:59.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 15 client.32290.objecter _session_command_op_remove -1 2 2024-04-15T15:24:59.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 20 client.32290.objecter get_session s=0x7f05a0077210 osd=1 3 2024-04-15T15:24:59.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 15 client.32290.objecter _session_command_op_assign 1 2 2024-04-15T15:24:59.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 20 client.32290.objecter put_session s=0x7f05a0077210 osd=1 4 2024-04-15T15:24:59.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 10 client.32290.objecter _send_command 2 2024-04-15T15:24:59.080 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.078+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 --> v1:172.21.15.38:6806/3103013511 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f05bc0ab830 con 0x7f05a00778c0 2024-04-15T15:24:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.092+0000 7f05b1ffb640 1 -- 172.21.15.38:0/2227471197 <== osd.1 v1:172.21.15.38:6806/3103013511 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f05bc0ab830 con 0x7f05a00778c0 2024-04-15T15:24:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.092+0000 7f05b1ffb640 10 client.32290.objecter ms_dispatch 0x7f05bc000b90 command_reply(tid 2: 0 ) 2024-04-15T15:24:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.092+0000 7f05b1ffb640 10 client.32290.objecter _finish_command 2 = system:0 2024-04-15T15:24:59.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.092+0000 7f05b1ffb640 20 client.32290.objecter put_session s=0x7f05a0077210 osd=1 4 2024-04-15T15:24:59.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.092+0000 7f05b1ffb640 15 client.32290.objecter _session_command_op_remove 1 2 2024-04-15T15:24:59.095 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-15T15:24:59.095 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:24:59.095 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-15T15:24:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.092+0000 7f05c37c8640 10 librados: watch_flush enter 2024-04-15T15:24:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 10 librados: watch_flush exit 2024-04-15T15:24:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 10 client.32290.objecter close_session for osd.1 2024-04-15T15:24:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 >> v1:172.21.15.38:6806/3103013511 conn(0x7f05a00778c0 legacy=0x7f05a0079d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 20 client.32290.objecter put_session s=0x7f05a0077210 osd=1 1 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 20 client.32290.objecter shutdown clearing up homeless session... 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 10 client.32290.objecter successfully canceled tick 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 >> v1:172.21.15.38:6800/1608957829 conn(0x7f05a006ef70 legacy=0x7f05a0071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 10 monclient: shutdown 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 >> v1:172.21.15.164:6789/0 conn(0x7f05bc0af660 legacy=0x7f05bc139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c1d65640 1 -- 172.21.15.38:0/2227471197 reap_dead start 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 shutdown_connections 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 >> 172.21.15.38:0/2227471197 conn(0x7f05bc068070 msgr2=0x7f05bc0b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 shutdown_connections 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 1 -- 172.21.15.38:0/2227471197 wait complete. 2024-04-15T15:24:59.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.093+0000 7f05c37c8640 1 librados: shutdown 2024-04-15T15:24:59.105 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-15T15:24:59.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.208+0000 7f9b59532640 10 monclient: get_monmap_and_config 2024-04-15T15:24:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.208+0000 7f9b59532640 10 monclient: build_initial_monmap 2024-04-15T15:24:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.208+0000 7f9b59532640 10 monclient: monmap: 2024-04-15T15:24:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:24:59.208965+0000 2024-04-15T15:24:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:24:59.208965+0000 2024-04-15T15:24:59.210 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:24:59.211 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:24:59.211 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.208+0000 7f9b59532640 1 Processor -- start 2024-04-15T15:24:59.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.208+0000 7f9b59532640 1 -- start start 2024-04-15T15:24:59.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.208+0000 7f9b59532640 10 monclient: init 2024-04-15T15:24:59.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:59.212 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 10 monclient(hunting): picked mon.noname-a con 0x7f9b540b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 10 monclient(hunting): picked mon.noname-b con 0x7f9b540b5bb0 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 10 monclient(hunting): picked mon.noname-c con 0x7f9b54140b30 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b54146e10 con 0x7f9b540b57d0 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b540aa840 con 0x7f9b54140b30 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b540aa460 con 0x7f9b540b5bb0 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.209+0000 7f9b59532640 10 monclient(hunting): authenticate will time out at 2959.480045s 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.210+0000 7f9b52ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9b540b57d0 0x7f9b54146700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44248/0 (socket says 172.21.15.38:44248) 2024-04-15T15:24:59.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.210+0000 7f9b52ffd640 1 -- 172.21.15.38:0/1550514568 learned_addr learned my addr 172.21.15.38:0/1550514568 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321954241 0 0) 0x7f9b540aa840 con 0x7f9b54140b30 2024-04-15T15:24:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): my global_id is 32293 2024-04-15T15:24:59.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b40003520 con 0x7f9b54140b30 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377791149 0 0) 0x7f9b54146e10 con 0x7f9b540b57d0 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): my global_id is 33576 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b540aa840 con 0x7f9b540b57d0 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579696462 0 0) 0x7f9b540aa460 con 0x7f9b540b5bb0 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 10 monclient(hunting): my global_id is 81041 2024-04-15T15:24:59.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.212+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b54146e10 con 0x7f9b540b5bb0 2024-04-15T15:24:59.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3722312388 0 0) 0x7f9b40003520 con 0x7f9b54140b30 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 >> v1:172.21.15.38:6790/0 conn(0x7f9b540b5bb0 legacy=0x7f9b54140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 >> v1:172.21.15.38:6789/0 conn(0x7f9b540b57d0 legacy=0x7f9b54146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 10 monclient: _finish_hunting 0 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 1 monclient: found mon.noname-c 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b540b2970 con 0x7f9b54140b30 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 10 monclient: _finish_auth 0 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b44001610 con 0x7f9b54140b30 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b59532640 5 monclient: authenticate success, global_id 32293 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:24:59.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b51ffb640 10 monclient: dump: 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.215+0000 7f9b59532640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:59.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.217+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b44001870 con 0x7f9b54140b30 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.217+0000 7f9b51ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.217+0000 7f9b51ffb640 1 -- 172.21.15.38:0/1550514568 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b44001c40 con 0x7f9b54140b30 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.217+0000 7f9b51ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.217+0000 7f9b51ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.217+0000 7f9b51ffb640 10 monclient: dump: 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.220 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.217+0000 7f9b59532640 10 monclient: get_monmap_and_config success 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.217+0000 7f9b59532640 4 set_mon_vals no callback set 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.218+0000 7f9b59532640 10 monclient: shutdown 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.218+0000 7f9b59532640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.218+0000 7f9b59532640 1 -- 172.21.15.38:0/1550514568 >> v1:172.21.15.164:6789/0 conn(0x7f9b54140b30 legacy=0x7f9b5414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.218+0000 7f9b59532640 1 -- 172.21.15.38:0/1550514568 shutdown_connections 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.218+0000 7f9b59532640 1 -- 172.21.15.38:0/1550514568 >> 172.21.15.38:0/1550514568 conn(0x7f9b54067790 msgr2=0x7f9b54067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.218+0000 7f9b59532640 1 -- 172.21.15.38:0/1550514568 shutdown_connections 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.218+0000 7f9b59532640 1 -- 172.21.15.38:0/1550514568 wait complete. 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.218+0000 7f9b59532640 10 monclient: build_initial_monmap 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.218+0000 7f9b59532640 10 monclient: monmap: 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:24:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:24:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:24:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:24:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:24:59.222 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.219+0000 7f9b59532640 1 librados: starting msgr at 2024-04-15T15:24:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.219+0000 7f9b59532640 1 librados: starting objecter 2024-04-15T15:24:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.219+0000 7f9b59532640 1 Processor -- start 2024-04-15T15:24:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.219+0000 7f9b59532640 1 -- start start 2024-04-15T15:24:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.219+0000 7f9b59532640 1 librados: setting wanted keys 2024-04-15T15:24:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.219+0000 7f9b59532640 1 librados: calling monclient init 2024-04-15T15:24:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.219+0000 7f9b59532640 10 monclient: init 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.219+0000 7f9b59532640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.219+0000 7f9b59532640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b59532640 10 monclient(hunting): picked mon.noname-b con 0x7f9b540b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b59532640 10 monclient(hunting): picked mon.noname-a con 0x7f9b540b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b59532640 10 monclient(hunting): picked mon.noname-c con 0x7f9b54140b30 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b59532640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b540ad720 con 0x7f9b540b5bb0 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b59532640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b54142900 con 0x7f9b540b57d0 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b59532640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b54145330 con 0x7f9b54140b30 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b59532640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b59532640 10 monclient(hunting): authenticate will time out at 2959.490513s 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b537fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f9b54140b30 0x7f9b541e3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56078/0 (socket says 172.21.15.38:56078) 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b527fc640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9b540b5bb0 0x7f9b541d8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44250/0 (socket says 172.21.15.38:44250) 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b537fe640 1 -- 172.21.15.38:0/2979961975 learned_addr learned my addr 172.21.15.38:0/2979961975 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b4b7fe640 10 client.?.objecter ms_handle_connect 0x7f9b540b57d0 2024-04-15T15:24:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b4b7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b4b7fe640 10 client.?.objecter ms_handle_connect 0x7f9b54140b30 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b4b7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b4b7fe640 10 client.?.objecter ms_handle_connect 0x7f9b540b5bb0 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.220+0000 7f9b4b7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.222+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115334023 0 0) 0x7f9b54142900 con 0x7f9b540b57d0 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.222+0000 7f9b4b7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.222+0000 7f9b4b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.222+0000 7f9b4b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.222+0000 7f9b4b7fe640 10 monclient(hunting): my global_id is 32296 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.222+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b34004eb0 con 0x7f9b540b57d0 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974846766 0 0) 0x7f9b54145330 con 0x7f9b54140b30 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 10 monclient(hunting): my global_id is 81044 2024-04-15T15:24:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b54142900 con 0x7f9b54140b30 2024-04-15T15:24:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96222094 0 0) 0x7f9b540ad720 con 0x7f9b540b5bb0 2024-04-15T15:24:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 10 monclient(hunting): my global_id is 33579 2024-04-15T15:24:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.223+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b54145330 con 0x7f9b540b5bb0 2024-04-15T15:24:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 757851170 0 0) 0x7f9b34004eb0 con 0x7f9b540b57d0 2024-04-15T15:24:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b540ad720 con 0x7f9b540b57d0 2024-04-15T15:24:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b4c001c30 con 0x7f9b540b57d0 2024-04-15T15:24:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:24:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 10 monclient(hunting): dump: 2024-04-15T15:24:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.229 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:24:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3543188330 0 0) 0x7f9b54142900 con 0x7f9b54140b30 2024-04-15T15:24:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b34004eb0 con 0x7f9b54140b30 2024-04-15T15:24:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b44001bc0 con 0x7f9b54140b30 2024-04-15T15:24:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:24:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.227+0000 7f9b4b7fe640 10 monclient(hunting): dump: 2024-04-15T15:24:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.228+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1421895787 0 0) 0x7f9b54145330 con 0x7f9b540b5bb0 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.228+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b54142900 con 0x7f9b540b5bb0 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.228+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b3c0018b0 con 0x7f9b540b5bb0 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.228+0000 7f9b4b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.228+0000 7f9b4b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.228+0000 7f9b4b7fe640 10 monclient(hunting): dump: 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.231 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.232 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.232 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.232 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.232 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.232 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.232 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.232 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.232 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 538769309 0 0) 0x7f9b540ad720 con 0x7f9b540b57d0 2024-04-15T15:24:59.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 >> v1:172.21.15.38:6790/0 conn(0x7f9b54140b30 legacy=0x7f9b541e3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 >> v1:172.21.15.38:6789/0 conn(0x7f9b540b5bb0 legacy=0x7f9b541d8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 10 monclient: _finish_hunting 0 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 1 monclient: found mon.b 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b541d94b0 con 0x7f9b540b57d0 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 10 monclient: _finish_auth 0 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 10 monclient: _check_auth_tickets 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b4b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b59532640 5 monclient: authenticate success, global_id 32296 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b59532640 10 monclient: _renew_subs 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b59532640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b540ac730 con 0x7f9b540b57d0 2024-04-15T15:24:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b59532640 10 client.32296.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b59532640 10 monclient: _renew_subs 2024-04-15T15:24:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b59532640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b541e4b90 con 0x7f9b540b57d0 2024-04-15T15:24:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.230+0000 7f9b59532640 1 librados: init done 2024-04-15T15:24:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.231+0000 7f9b59532640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.231+0000 7f9b59532640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.231+0000 7f9b59532640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.231+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b541d9680 con 0x7f9b540b57d0 2024-04-15T15:24:59.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.245+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b4c004b60 con 0x7f9b540b57d0 2024-04-15T15:24:59.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.245+0000 7f9b4b7fe640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:59.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.245+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f9b4c004eb0 con 0x7f9b540b57d0 2024-04-15T15:24:59.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.245+0000 7f9b4b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:59.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.245+0000 7f9b4b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:59.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.245+0000 7f9b4b7fe640 10 monclient: dump: 2024-04-15T15:24:59.247 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.247 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.247 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.248 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.248 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.248 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.248 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.248 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.248 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.248 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.245+0000 7f9b517fa640 4 set_mon_vals no callback set 2024-04-15T15:24:59.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.246+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f9b4c01b3e0 con 0x7f9b540b57d0 2024-04-15T15:24:59.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.247+0000 7f9b527fc640 10 monclient: get_auth_request con 0x7f9b3406f020 auth_method 0 2024-04-15T15:24:59.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.247+0000 7f9b4b7fe640 10 client.32296.objecter ms_handle_connect 0x7f9b3406f020 2024-04-15T15:24:59.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.247+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7f9b4c053600 con 0x7f9b540b57d0 2024-04-15T15:24:59.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.247+0000 7f9b4b7fe640 10 client.32296.objecter ms_dispatch 0x7f9b54000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:24:59.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.247+0000 7f9b4b7fe640 3 client.32296.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:24:59.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.247+0000 7f9b4b7fe640 3 client.32296.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:24:59.249 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.247+0000 7f9b4b7fe640 20 client.32296.objecter dump_active .. 0 homeless 2024-04-15T15:24:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.486+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f9b4c055a00 con 0x7f9b540b57d0 2024-04-15T15:24:59.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.486+0000 7f9b4b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:59.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.486+0000 7f9b4b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:24:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.674+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9b540b2cc0 con 0x7f9b3406f020 2024-04-15T15:24:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.674+0000 7f9b4b7fe640 1 -- 172.21.15.38:0/2979961975 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f9b540b2cc0 con 0x7f9b3406f020 2024-04-15T15:24:59.675 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 1 to deep-scrub 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 10 librados: watch_flush enter 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 10 librados: watch_flush exit 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 20 client.32296.objecter shutdown clearing up homeless session... 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 10 client.32296.objecter successfully canceled tick 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 >> v1:172.21.15.38:6800/1608957829 conn(0x7f9b3406f020 legacy=0x7f9b340714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 10 monclient: shutdown 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 >> v1:172.21.15.164:6789/0 conn(0x7f9b540b57d0 legacy=0x7f9b54145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 shutdown_connections 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 >> 172.21.15.38:0/2979961975 conn(0x7f9b54067790 msgr2=0x7f9b540b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 shutdown_connections 2024-04-15T15:24:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 1 -- 172.21.15.38:0/2979961975 wait complete. 2024-04-15T15:24:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.676+0000 7f9b59532640 1 librados: shutdown 2024-04-15T15:24:59.689 INFO:tasks.ceph:Scrubbing osd.2 2024-04-15T15:24:59.689 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:24:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.795+0000 7fe214c14640 10 monclient: get_monmap_and_config 2024-04-15T15:24:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.795+0000 7fe214c14640 10 monclient: build_initial_monmap 2024-04-15T15:24:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.795+0000 7fe214c14640 10 monclient: monmap: 2024-04-15T15:24:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:24:59.795853+0000 2024-04-15T15:24:59.796 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:24:59.795853+0000 2024-04-15T15:24:59.797 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:59.797 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.797 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:59.797 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:24:59.797 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:24:59.797 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.795+0000 7fe214c14640 1 Processor -- start 2024-04-15T15:24:59.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.795+0000 7fe214c14640 1 -- start start 2024-04-15T15:24:59.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.795+0000 7fe214c14640 10 monclient: init 2024-04-15T15:24:59.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:59.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T15:24:59.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 10 monclient(hunting): picked mon.noname-a con 0x7fe2100b5a20 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 10 monclient(hunting): picked mon.noname-c con 0x7fe21013cd80 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 10 monclient(hunting): picked mon.noname-b con 0x7fe21013d200 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21013d610 con 0x7fe2100b5a20 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2100ac1c0 con 0x7fe21013cd80 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2100b5180 con 0x7fe21013d200 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.796+0000 7fe214c14640 10 monclient(hunting): authenticate will time out at 2960.066905s 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.797+0000 7fe20ed9d640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fe21013d200 0x7fe21014ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56092/0 (socket says 172.21.15.38:56092) 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.797+0000 7fe20e59c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe2100b5a20 0x7fe2100aa920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44264/0 (socket says 172.21.15.38:44264) 2024-04-15T15:24:59.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.797+0000 7fe20ed9d640 1 -- 172.21.15.38:0/3095738385 learned_addr learned my addr 172.21.15.38:0/3095738385 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301263762 0 0) 0x7fe2100b5180 con 0x7fe21013d200 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): my global_id is 81047 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f8003520 con 0x7fe21013d200 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306647999 0 0) 0x7fe2100ac1c0 con 0x7fe21013cd80 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.801 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): my global_id is 32299 2024-04-15T15:24:59.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2100b5180 con 0x7fe21013cd80 2024-04-15T15:24:59.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298282453 0 0) 0x7fe21013d610 con 0x7fe2100b5a20 2024-04-15T15:24:59.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 10 monclient(hunting): my global_id is 33582 2024-04-15T15:24:59.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.799+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2100ac1c0 con 0x7fe2100b5a20 2024-04-15T15:24:59.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3241094038 0 0) 0x7fe2100b5180 con 0x7fe21013cd80 2024-04-15T15:24:59.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 >> v1:172.21.15.38:6790/0 conn(0x7fe21013d200 legacy=0x7fe21014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 >> v1:172.21.15.38:6789/0 conn(0x7fe2100b5a20 legacy=0x7fe2100aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 10 monclient: _finish_hunting 0 2024-04-15T15:24:59.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 1 monclient: found mon.noname-c 2024-04-15T15:24:59.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:59.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe210143ca0 con 0x7fe21013cd80 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 10 monclient: _finish_auth 0 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 10 monclient: _check_auth_tickets 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe2040015f0 con 0x7fe21013cd80 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe214c14640 5 monclient: authenticate success, global_id 32299 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe214c14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe20d59a640 10 monclient: dump: 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.805 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.806 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.806 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.806 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.806 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.802+0000 7fe214c14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.804+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe204001850 con 0x7fe21013cd80 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.804+0000 7fe20d59a640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.804+0000 7fe20d59a640 1 -- 172.21.15.38:0/3095738385 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe204001c60 con 0x7fe21013cd80 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.804+0000 7fe20d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.804+0000 7fe20d59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.804+0000 7fe20d59a640 10 monclient: dump: 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.809 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.804+0000 7fe214c14640 10 monclient: get_monmap_and_config success 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.804+0000 7fe214c14640 4 set_mon_vals no callback set 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.805+0000 7fe214c14640 10 monclient: shutdown 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.805+0000 7fe214c14640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.805+0000 7fe214c14640 1 -- 172.21.15.38:0/3095738385 >> v1:172.21.15.164:6789/0 conn(0x7fe21013cd80 legacy=0x7fe210143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.805+0000 7fe214c14640 1 -- 172.21.15.38:0/3095738385 shutdown_connections 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.805+0000 7fe214c14640 1 -- 172.21.15.38:0/3095738385 >> 172.21.15.38:0/3095738385 conn(0x7fe210067790 msgr2=0x7fe210067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.805+0000 7fe214c14640 1 -- 172.21.15.38:0/3095738385 shutdown_connections 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.805+0000 7fe214c14640 1 -- 172.21.15.38:0/3095738385 wait complete. 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 10 monclient: build_initial_monmap 2024-04-15T15:24:59.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 10 monclient: monmap: 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 1 librados: starting msgr at 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 1 librados: starting objecter 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 1 Processor -- start 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 1 -- start start 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 1 librados: setting wanted keys 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 1 librados: calling monclient init 2024-04-15T15:24:59.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 10 monclient: init 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 10 monclient: _reopen_session rank -1 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.806+0000 7fe214c14640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe214c14640 10 monclient(hunting): picked mon.noname-a con 0x7fe2100b5a20 addr v1:172.21.15.38:6789/0 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe214c14640 10 monclient(hunting): picked mon.noname-c con 0x7fe21013cd80 addr v1:172.21.15.38:6790/0 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe214c14640 10 monclient(hunting): picked mon.noname-b con 0x7fe21013d200 addr v1:172.21.15.164:6789/0 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe214c14640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2100af9c0 con 0x7fe2100b5a20 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe214c14640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2100aebc0 con 0x7fe21013d200 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe214c14640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2100aed90 con 0x7fe21013cd80 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe214c14640 10 monclient(hunting): _renew_subs 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe214c14640 10 monclient(hunting): authenticate will time out at 2960.077511s 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe20dd9b640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fe21013cd80 0x7fe21013be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56106/0 (socket says 172.21.15.38:56106) 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe20dd9b640 1 -- 172.21.15.38:0/3211297633 learned_addr learned my addr 172.21.15.38:0/3211297633 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe1feffd640 10 client.?.objecter ms_handle_connect 0x7fe21013cd80 2024-04-15T15:24:59.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe1feffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:59.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe1feffd640 10 client.?.objecter ms_handle_connect 0x7fe2100b5a20 2024-04-15T15:24:59.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.807+0000 7fe1feffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:59.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.808+0000 7fe1feffd640 10 client.?.objecter ms_handle_connect 0x7fe21013d200 2024-04-15T15:24:59.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.808+0000 7fe1feffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:24:59.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077436872 0 0) 0x7fe2100aebc0 con 0x7fe21013d200 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 10 monclient(hunting): my global_id is 32302 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f0004eb0 con 0x7fe21013d200 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932344021 0 0) 0x7fe2100aed90 con 0x7fe21013cd80 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 10 monclient(hunting): my global_id is 81050 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2100aebc0 con 0x7fe21013cd80 2024-04-15T15:24:59.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.809+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579586008 0 0) 0x7fe2100af9c0 con 0x7fe2100b5a20 2024-04-15T15:24:59.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.810+0000 7fe1feffd640 10 monclient(hunting): _negotiate 2024-04-15T15:24:59.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.810+0000 7fe1feffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:24:59.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.810+0000 7fe1feffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:24:59.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.810+0000 7fe1feffd640 10 monclient(hunting): my global_id is 33585 2024-04-15T15:24:59.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.810+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2100aed90 con 0x7fe2100b5a20 2024-04-15T15:24:59.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3118392574 0 0) 0x7fe1f0004eb0 con 0x7fe21013d200 2024-04-15T15:24:59.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2100af9c0 con 0x7fe21013d200 2024-04-15T15:24:59.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe208001ad0 con 0x7fe21013d200 2024-04-15T15:24:59.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:59.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:24:59.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): dump: 2024-04-15T15:24:59.816 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.816 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2514270522 0 0) 0x7fe2100aebc0 con 0x7fe21013cd80 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1f0004eb0 con 0x7fe21013cd80 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe204001c60 con 0x7fe21013cd80 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): dump: 2024-04-15T15:24:59.817 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2121675644 0 0) 0x7fe2100aed90 con 0x7fe2100b5a20 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2100aebc0 con 0x7fe2100b5a20 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe200001870 con 0x7fe2100b5a20 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:24:59.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.814+0000 7fe1feffd640 10 monclient(hunting): dump: 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.819 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 581784252 0 0) 0x7fe2100af9c0 con 0x7fe21013d200 2024-04-15T15:24:59.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 >> v1:172.21.15.38:6790/0 conn(0x7fe21013cd80 legacy=0x7fe21013be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 >> v1:172.21.15.38:6789/0 conn(0x7fe2100b5a20 legacy=0x7fe2100af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 10 monclient: _finish_hunting 0 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 1 monclient: found mon.b 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe210140510 con 0x7fe21013d200 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 10 monclient: _finish_auth 0 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 10 monclient: _check_auth_tickets 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe1feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe214c14640 5 monclient: authenticate success, global_id 32302 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe214c14640 10 monclient: _renew_subs 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe214c14640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe2101407a0 con 0x7fe21013d200 2024-04-15T15:24:59.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe214c14640 10 client.32302.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe214c14640 10 monclient: _renew_subs 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe214c14640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe21013c6f0 con 0x7fe21013d200 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.817+0000 7fe214c14640 1 librados: init done 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.818+0000 7fe214c14640 10 client.32302.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.818+0000 7fe214c14640 15 client.32302.objecter _session_command_op_assign -1 1 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.818+0000 7fe214c14640 20 client.32302.objecter _get_session osd=-1 returning homeless 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.818+0000 7fe214c14640 10 client.32302.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.818+0000 7fe214c14640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:24:59.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.818+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe2100afbd0 con 0x7fe21013d200 2024-04-15T15:24:59.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.832+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe2100afbd0 con 0x7fe21013d200 2024-04-15T15:24:59.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.832+0000 7fe1feffd640 10 monclient: handle_config config(0 keys) 2024-04-15T15:24:59.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.832+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe208004b60 con 0x7fe21013d200 2024-04-15T15:24:59.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.832+0000 7fe1feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:24:59.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.832+0000 7fe1feffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:24:59.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.832+0000 7fe1feffd640 10 monclient: dump: 2024-04-15T15:24:59.834 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:24:59.834 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:24:59.834 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.835 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:24:59.835 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:24:59.835 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:24:59.835 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:24:59.835 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:24:59.835 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:24:59.835 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:24:59.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.832+0000 7fe20cd99640 4 set_mon_vals no callback set 2024-04-15T15:24:59.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.833+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fe208004d40 con 0x7fe21013d200 2024-04-15T15:24:59.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.834+0000 7fe20e59c640 10 monclient: get_auth_request con 0x7fe1f006efc0 auth_method 0 2024-04-15T15:24:59.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.834+0000 7fe1feffd640 10 client.32302.objecter ms_handle_connect 0x7fe1f006efc0 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7fe208053320 con 0x7fe21013d200 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 10 client.32302.objecter ms_dispatch 0x7fe210000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 3 client.32302.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 3 client.32302.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 10 client.32302.objecter checking command 1 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 20 client.32302.objecter _get_session s=0x7fe1f0077260 osd=2 3 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 20 client.32302.objecter put_session s=0x7fe1f0077260 osd=2 3 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 15 client.32302.objecter _session_command_op_remove -1 1 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 20 client.32302.objecter _get_session s=0x7fe1f0077260 osd=2 3 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 20 client.32302.objecter get_session s=0x7fe1f0077260 osd=2 3 2024-04-15T15:24:59.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 15 client.32302.objecter _session_command_op_assign 2 1 2024-04-15T15:24:59.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 20 client.32302.objecter put_session s=0x7fe1f0077260 osd=2 4 2024-04-15T15:24:59.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 10 client.32302.objecter _send_command 1 2024-04-15T15:24:59.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.38:6801/2505059545 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1f007b620 con 0x7fe1f0077910 2024-04-15T15:24:59.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe1feffd640 20 client.32302.objecter dump_active .. 0 homeless 2024-04-15T15:24:59.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.835+0000 7fe20dd9b640 10 monclient: get_auth_request con 0x7fe1f0077910 auth_method 0 2024-04-15T15:24:59.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.837+0000 7fe1feffd640 10 client.32302.objecter ms_handle_connect 0x7fe1f0077910 2024-04-15T15:24:59.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.837+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=996) ==== 24+0+0 (unknown 3060284901 0 0) 0x7fe208051230 con 0x7fe21013d200 2024-04-15T15:24:59.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.837+0000 7fe1feffd640 10 monclient: handle_get_version_reply finishing 1 version 996 2024-04-15T15:24:59.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.862+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== osd.2 v1:172.21.15.38:6801/2505059545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fe1f007b620 con 0x7fe1f0077910 2024-04-15T15:24:59.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.862+0000 7fe1feffd640 10 client.32302.objecter ms_dispatch 0x7fe210000b90 command_reply(tid 1: 0 ) 2024-04-15T15:24:59.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.862+0000 7fe1feffd640 10 client.32302.objecter _finish_command 1 = system:0 2024-04-15T15:24:59.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.862+0000 7fe1feffd640 20 client.32302.objecter put_session s=0x7fe1f0077260 osd=2 4 2024-04-15T15:24:59.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.862+0000 7fe1feffd640 15 client.32302.objecter _session_command_op_remove 2 1 2024-04-15T15:24:59.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 10 client.32302.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 15 client.32302.objecter _session_command_op_assign -1 2 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 20 client.32302.objecter _get_session s=0x7fe1f0077260 osd=2 3 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 20 client.32302.objecter put_session s=0x7fe1f0077260 osd=2 3 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 20 client.32302.objecter _get_session s=0x7fe1f0077260 osd=2 3 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 15 client.32302.objecter _session_command_op_remove -1 2 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 20 client.32302.objecter get_session s=0x7fe1f0077260 osd=2 3 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 15 client.32302.objecter _session_command_op_assign 2 2 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 20 client.32302.objecter put_session s=0x7fe1f0077260 osd=2 4 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 10 client.32302.objecter _send_command 2 2024-04-15T15:24:59.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.875+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 --> v1:172.21.15.38:6801/2505059545 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe210077050 con 0x7fe1f0077910 2024-04-15T15:24:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.888+0000 7fe1feffd640 1 -- 172.21.15.38:0/3211297633 <== osd.2 v1:172.21.15.38:6801/2505059545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe210077050 con 0x7fe1f0077910 2024-04-15T15:24:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.888+0000 7fe1feffd640 10 client.32302.objecter ms_dispatch 0x7fe210000b90 command_reply(tid 2: 0 ) 2024-04-15T15:24:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.888+0000 7fe1feffd640 10 client.32302.objecter _finish_command 2 = system:0 2024-04-15T15:24:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.888+0000 7fe1feffd640 20 client.32302.objecter put_session s=0x7fe1f0077260 osd=2 4 2024-04-15T15:24:59.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.888+0000 7fe1feffd640 15 client.32302.objecter _session_command_op_remove 2 2 2024-04-15T15:24:59.890 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-15T15:24:59.890 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:24:59.890 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 10 librados: watch_flush enter 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 10 librados: watch_flush exit 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 10 client.32302.objecter close_session for osd.2 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 >> v1:172.21.15.38:6801/2505059545 conn(0x7fe1f0077910 legacy=0x7fe1f0079db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 20 client.32302.objecter put_session s=0x7fe1f0077260 osd=2 1 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 20 client.32302.objecter shutdown clearing up homeless session... 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 10 client.32302.objecter successfully canceled tick 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 >> v1:172.21.15.38:6800/1608957829 conn(0x7fe1f006efc0 legacy=0x7fe1f0071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 10 monclient: shutdown 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 >> v1:172.21.15.164:6789/0 conn(0x7fe21013d200 legacy=0x7fe2101db9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:24:59.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe20ed9d640 1 -- 172.21.15.38:0/3211297633 reap_dead start 2024-04-15T15:24:59.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 shutdown_connections 2024-04-15T15:24:59.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 >> 172.21.15.38:0/3211297633 conn(0x7fe210067790 msgr2=0x7fe2100aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:24:59.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 shutdown_connections 2024-04-15T15:24:59.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 1 -- 172.21.15.38:0/3211297633 wait complete. 2024-04-15T15:24:59.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:24:59.889+0000 7fe214c14640 1 librados: shutdown 2024-04-15T15:24:59.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-15T15:25:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.007+0000 7f0a0e132640 10 monclient: get_monmap_and_config 2024-04-15T15:25:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.007+0000 7f0a0e132640 10 monclient: build_initial_monmap 2024-04-15T15:25:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.007+0000 7f0a0e132640 10 monclient: monmap: 2024-04-15T15:25:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:00.007910+0000 2024-04-15T15:25:00.008 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:00.007910+0000 2024-04-15T15:25:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:00.009 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:00.009 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.007+0000 7f0a0e132640 1 Processor -- start 2024-04-15T15:25:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.007+0000 7f0a0e132640 1 -- start start 2024-04-15T15:25:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.007+0000 7f0a0e132640 10 monclient: init 2024-04-15T15:25:00.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 10 monclient(hunting): picked mon.noname-a con 0x7f0a080b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 10 monclient(hunting): picked mon.noname-b con 0x7f0a080b5bb0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 10 monclient(hunting): picked mon.noname-c con 0x7f0a08140b30 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08146e10 con 0x7f0a080b57d0 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a080aa840 con 0x7f0a08140b30 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a080aa460 con 0x7f0a080b5bb0 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.008+0000 7f0a0e132640 10 monclient(hunting): authenticate will time out at 2960.279037s 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.009+0000 7f0a06ffd640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f0a080b5bb0 0x7f0a08140420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56118/0 (socket says 172.21.15.38:56118) 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.009+0000 7f0a06ffd640 1 -- 172.21.15.38:0/1050182431 learned_addr learned my addr 172.21.15.38:0/1050182431 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:00.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.009+0000 7f0a077fe640 1 --1- 172.21.15.38:0/1050182431 >> v1:172.21.15.38:6789/0 conn(0x7f0a080b57d0 0x7f0a08146700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44274/0 (socket says 172.21.15.38:44274) 2024-04-15T15:25:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432160430 0 0) 0x7f0a080aa460 con 0x7f0a080b5bb0 2024-04-15T15:25:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): my global_id is 81053 2024-04-15T15:25:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09f0003520 con 0x7f0a080b5bb0 2024-04-15T15:25:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391048829 0 0) 0x7f0a08146e10 con 0x7f0a080b57d0 2024-04-15T15:25:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): my global_id is 33588 2024-04-15T15:25:00.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a080aa460 con 0x7f0a080b57d0 2024-04-15T15:25:00.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236133019 0 0) 0x7f0a080aa840 con 0x7f0a08140b30 2024-04-15T15:25:00.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 10 monclient(hunting): my global_id is 32305 2024-04-15T15:25:00.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.011+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a08146e10 con 0x7f0a08140b30 2024-04-15T15:25:00.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 771324262 0 0) 0x7f0a08146e10 con 0x7f0a08140b30 2024-04-15T15:25:00.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 >> v1:172.21.15.38:6790/0 conn(0x7f0a080b5bb0 legacy=0x7f0a08140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 >> v1:172.21.15.38:6789/0 conn(0x7f0a080b57d0 legacy=0x7f0a08146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 10 monclient: _finish_hunting 0 2024-04-15T15:25:00.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 1 monclient: found mon.noname-c 2024-04-15T15:25:00.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:00.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a080b2970 con 0x7f0a08140b30 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 10 monclient: _finish_auth 0 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 10 monclient: _check_auth_tickets 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.014+0000 7f0a067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.015+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0a00001930 con 0x7f0a08140b30 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.015+0000 7f0a067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.015+0000 7f0a067fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.015+0000 7f0a067fc640 10 monclient: dump: 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.017 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.018 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.018 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.018 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.018 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.015+0000 7f0a0e132640 5 monclient: authenticate success, global_id 32305 2024-04-15T15:25:00.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.015+0000 7f0a0e132640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:00.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a00001b90 con 0x7f0a08140b30 2024-04-15T15:25:00.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a067fc640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:00.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a067fc640 1 -- 172.21.15.38:0/1050182431 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0a00001f60 con 0x7f0a08140b30 2024-04-15T15:25:00.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a0e132640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:00.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a0e132640 4 set_mon_vals no callback set 2024-04-15T15:25:00.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:00.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a067fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:00.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a067fc640 10 monclient: dump: 2024-04-15T15:25:00.019 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a0e132640 10 monclient: shutdown 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a0e132640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a0e132640 1 -- 172.21.15.38:0/1050182431 >> v1:172.21.15.164:6789/0 conn(0x7f0a08140b30 legacy=0x7f0a0814ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a0e132640 1 -- 172.21.15.38:0/1050182431 shutdown_connections 2024-04-15T15:25:00.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a0e132640 1 -- 172.21.15.38:0/1050182431 >> 172.21.15.38:0/1050182431 conn(0x7f0a08067790 msgr2=0x7f0a08067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:00.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a0e132640 1 -- 172.21.15.38:0/1050182431 shutdown_connections 2024-04-15T15:25:00.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.017+0000 7f0a0e132640 1 -- 172.21.15.38:0/1050182431 wait complete. 2024-04-15T15:25:00.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.018+0000 7f0a0e132640 10 monclient: build_initial_monmap 2024-04-15T15:25:00.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.018+0000 7f0a0e132640 10 monclient: monmap: 2024-04-15T15:25:00.022 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:00.022 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.018+0000 7f0a0e132640 1 librados: starting msgr at 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.018+0000 7f0a0e132640 1 librados: starting objecter 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.018+0000 7f0a0e132640 1 Processor -- start 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 1 -- start start 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 1 librados: setting wanted keys 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 1 librados: calling monclient init 2024-04-15T15:25:00.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 10 monclient: init 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 10 monclient(hunting): picked mon.noname-b con 0x7f0a080b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 10 monclient(hunting): picked mon.noname-a con 0x7f0a080b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 10 monclient(hunting): picked mon.noname-c con 0x7f0a08140b30 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08139830 con 0x7f0a080b5bb0 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a080ae6d0 con 0x7f0a080b57d0 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08145e90 con 0x7f0a08140b30 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.019+0000 7f0a0e132640 10 monclient(hunting): authenticate will time out at 2960.290084s 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.020+0000 7f0a07fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f0a08140b30 0x7f0a08139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56126/0 (socket says 172.21.15.38:56126) 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.020+0000 7f0a07fff640 1 -- 172.21.15.38:0/3924869339 learned_addr learned my addr 172.21.15.38:0/3924869339 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.020+0000 7f09effff640 10 client.?.objecter ms_handle_connect 0x7f0a08140b30 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.020+0000 7f09effff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:00.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.020+0000 7f09effff640 10 client.?.objecter ms_handle_connect 0x7f0a080b5bb0 2024-04-15T15:25:00.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.020+0000 7f09effff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:00.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.020+0000 7f09effff640 10 client.?.objecter ms_handle_connect 0x7f0a080b57d0 2024-04-15T15:25:00.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.020+0000 7f09effff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785693714 0 0) 0x7f0a080ae6d0 con 0x7f0a080b57d0 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 10 monclient(hunting): my global_id is 32308 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09f4004eb0 con 0x7f0a080b57d0 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519528274 0 0) 0x7f0a08139830 con 0x7f0a080b5bb0 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 10 monclient(hunting): my global_id is 33591 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.022+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a080ae6d0 con 0x7f0a080b5bb0 2024-04-15T15:25:00.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.023+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112335707 0 0) 0x7f0a08145e90 con 0x7f0a08140b30 2024-04-15T15:25:00.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.023+0000 7f09effff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.023+0000 7f09effff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.023+0000 7f09effff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.023+0000 7f09effff640 10 monclient(hunting): my global_id is 81056 2024-04-15T15:25:00.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.023+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a08139830 con 0x7f0a08140b30 2024-04-15T15:25:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.027+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 109751124 0 0) 0x7f09f4004eb0 con 0x7f0a080b57d0 2024-04-15T15:25:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.027+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a08145e90 con 0x7f0a080b57d0 2024-04-15T15:25:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.027+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f09f8001830 con 0x7f0a080b57d0 2024-04-15T15:25:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.027+0000 7f09effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.027+0000 7f09effff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.027+0000 7f09effff640 10 monclient(hunting): dump: 2024-04-15T15:25:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.028 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.029 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.027+0000 7f09effff640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.027+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 906840249 0 0) 0x7f0a080ae6d0 con 0x7f0a080b5bb0 2024-04-15T15:25:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09f4004eb0 con 0x7f0a080b5bb0 2024-04-15T15:25:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f09fc0018d0 con 0x7f0a080b5bb0 2024-04-15T15:25:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 10 monclient(hunting): dump: 2024-04-15T15:25:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.030 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 215955841 0 0) 0x7f0a08139830 con 0x7f0a08140b30 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a080ae6d0 con 0x7f0a08140b30 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f0a00001f20 con 0x7f0a08140b30 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:00.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.028+0000 7f09effff640 10 monclient(hunting): dump: 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.032 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4278168146 0 0) 0x7f0a08145e90 con 0x7f0a080b57d0 2024-04-15T15:25:00.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 >> v1:172.21.15.38:6790/0 conn(0x7f0a08140b30 legacy=0x7f0a08139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 >> v1:172.21.15.38:6789/0 conn(0x7f0a080b5bb0 legacy=0x7f0a08138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 10 monclient: _finish_hunting 0 2024-04-15T15:25:00.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 1 monclient: found mon.b 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a080ac8c0 con 0x7f0a080b57d0 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 10 monclient: _finish_auth 0 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 10 monclient: _check_auth_tickets 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f09effff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f0a0e132640 5 monclient: authenticate success, global_id 32308 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f0a0e132640 10 monclient: _renew_subs 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f0a0e132640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a080acb50 con 0x7f0a080b57d0 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f0a0e132640 10 client.32308.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f0a0e132640 10 monclient: _renew_subs 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f0a0e132640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a081dbfc0 con 0x7f0a080b57d0 2024-04-15T15:25:00.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.030+0000 7f0a0e132640 1 librados: init done 2024-04-15T15:25:00.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.031+0000 7f0a0e132640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:00.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.031+0000 7f0a0e132640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:00.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.031+0000 7f0a0e132640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.031+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a08146060 con 0x7f0a080b57d0 2024-04-15T15:25:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.046+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09f80047e0 con 0x7f0a080b57d0 2024-04-15T15:25:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.046+0000 7f09effff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.046+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f09f8004b30 con 0x7f0a080b57d0 2024-04-15T15:25:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.046+0000 7f09effff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.046+0000 7f09effff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.046+0000 7f09effff640 10 monclient: dump: 2024-04-15T15:25:00.047 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.046+0000 7f0a05ffb640 4 set_mon_vals no callback set 2024-04-15T15:25:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.047+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f09f801b060 con 0x7f0a080b57d0 2024-04-15T15:25:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.047+0000 7f0a06ffd640 10 monclient: get_auth_request con 0x7f09f406efc0 auth_method 0 2024-04-15T15:25:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.047+0000 7f09effff640 10 client.32308.objecter ms_handle_connect 0x7f09f406efc0 2024-04-15T15:25:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.047+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7f09f80531b0 con 0x7f0a080b57d0 2024-04-15T15:25:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.047+0000 7f09effff640 10 client.32308.objecter ms_dispatch 0x7f0a08000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:25:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.047+0000 7f09effff640 3 client.32308.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.047+0000 7f09effff640 3 client.32308.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:00.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.048+0000 7f09effff640 20 client.32308.objecter dump_active .. 0 homeless 2024-04-15T15:25:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.281+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f09f80555b0 con 0x7f0a080b57d0 2024-04-15T15:25:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.281+0000 7f09effff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:00.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.281+0000 7f09effff640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:25:00.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.500+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0a080ae4d0 con 0x7f09f406efc0 2024-04-15T15:25:00.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.500+0000 7f09effff640 1 -- 172.21.15.38:0/3924869339 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f0a080ae4d0 con 0x7f09f406efc0 2024-04-15T15:25:00.502 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 2 to deep-scrub 2024-04-15T15:25:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.502+0000 7f0a0e132640 10 librados: watch_flush enter 2024-04-15T15:25:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.502+0000 7f0a0e132640 10 librados: watch_flush exit 2024-04-15T15:25:00.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.502+0000 7f0a0e132640 20 client.32308.objecter shutdown clearing up homeless session... 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.502+0000 7f0a0e132640 10 client.32308.objecter successfully canceled tick 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.503+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 >> v1:172.21.15.38:6800/1608957829 conn(0x7f09f406efc0 legacy=0x7f09f4071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.503+0000 7f0a0e132640 10 monclient: shutdown 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.503+0000 7f0a0e132640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.503+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 >> v1:172.21.15.164:6789/0 conn(0x7f0a080b57d0 legacy=0x7f0a081dc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.503+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 shutdown_connections 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.503+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 >> 172.21.15.38:0/3924869339 conn(0x7f0a08067790 msgr2=0x7f0a080b8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.503+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 shutdown_connections 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.503+0000 7f0a0e132640 1 -- 172.21.15.38:0/3924869339 wait complete. 2024-04-15T15:25:00.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.503+0000 7f0a0e132640 1 librados: shutdown 2024-04-15T15:25:00.517 INFO:tasks.ceph:Scrubbing osd.3 2024-04-15T15:25:00.517 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:25:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.640+0000 7fdaa6e4a640 10 monclient: get_monmap_and_config 2024-04-15T15:25:00.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.640+0000 7fdaa6e4a640 10 monclient: build_initial_monmap 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.640+0000 7fdaa6e4a640 10 monclient: monmap: 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:00.641314+0000 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:00.641314+0000 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:00.642 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.641+0000 7fdaa6e4a640 1 Processor -- start 2024-04-15T15:25:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.641+0000 7fdaa6e4a640 1 -- start start 2024-04-15T15:25:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.641+0000 7fdaa6e4a640 10 monclient: init 2024-04-15T15:25:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.641+0000 7fdaa6e4a640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.641+0000 7fdaa6e4a640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:25:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.641+0000 7fdaa6e4a640 10 monclient(hunting): picked mon.noname-c con 0x7fdaa00753d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.641+0000 7fdaa6e4a640 10 monclient(hunting): picked mon.noname-b con 0x7fdaa00757b0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:00.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.641+0000 7fdaa6e4a640 10 monclient(hunting): picked mon.noname-a con 0x7fdaa00b0ac0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.641+0000 7fdaa6e4a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa00b0ef0 con 0x7fdaa00b0ac0 2024-04-15T15:25:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.642+0000 7fdaa6e4a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa00709f0 con 0x7fdaa00753d0 2024-04-15T15:25:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.642+0000 7fdaa6e4a640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa00b1910 con 0x7fdaa00757b0 2024-04-15T15:25:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.642+0000 7fdaa6e4a640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.642+0000 7fdaa6e4a640 10 monclient(hunting): authenticate will time out at 2960.912618s 2024-04-15T15:25:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.642+0000 7fda97fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fdaa00757b0 0x7fdaa0146640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56130/0 (socket says 172.21.15.38:56130) 2024-04-15T15:25:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.642+0000 7fdaa4be6640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fdaa00753d0 0x7fdaa013ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:52944/0 (socket says 172.21.15.38:52944) 2024-04-15T15:25:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.642+0000 7fda97fff640 1 -- 172.21.15.38:0/3787522996 learned_addr learned my addr 172.21.15.38:0/3787522996 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:00.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.642+0000 7fdaa53e7640 1 --1- 172.21.15.38:0/3787522996 >> v1:172.21.15.38:6789/0 conn(0x7fdaa00b0ac0 0x7fdaa0146d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44294/0 (socket says 172.21.15.38:44294) 2024-04-15T15:25:00.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187279588 0 0) 0x7fdaa00709f0 con 0x7fdaa00753d0 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): my global_id is 32311 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda88003520 con 0x7fdaa00753d0 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138912429 0 0) 0x7fdaa00b1910 con 0x7fdaa00757b0 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): my global_id is 81059 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa00709f0 con 0x7fdaa00757b0 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292955767 0 0) 0x7fdaa00b0ef0 con 0x7fdaa00b0ac0 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 10 monclient(hunting): my global_id is 33594 2024-04-15T15:25:00.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.645+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa00b1910 con 0x7fdaa00b0ac0 2024-04-15T15:25:00.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3251354074 0 0) 0x7fda88003520 con 0x7fdaa00753d0 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 >> v1:172.21.15.38:6790/0 conn(0x7fdaa00757b0 legacy=0x7fdaa0146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 >> v1:172.21.15.38:6789/0 conn(0x7fdaa00b0ac0 legacy=0x7fdaa0146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 10 monclient: _finish_hunting 0 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 1 monclient: found mon.noname-c 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa00b1190 con 0x7fdaa00753d0 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 10 monclient: _finish_auth 0 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 10 monclient: _check_auth_tickets 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda9c001610 con 0x7fdaa00753d0 2024-04-15T15:25:00.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fda977fe640 10 monclient: dump: 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fdaa6e4a640 5 monclient: authenticate success, global_id 32311 2024-04-15T15:25:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.648+0000 7fdaa6e4a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.649+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda9c001870 con 0x7fdaa00753d0 2024-04-15T15:25:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.649+0000 7fda977fe640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.649+0000 7fda977fe640 1 -- 172.21.15.38:0/3787522996 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda9c001bc0 con 0x7fdaa00753d0 2024-04-15T15:25:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.649+0000 7fda977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.649+0000 7fda977fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.649+0000 7fda977fe640 10 monclient: dump: 2024-04-15T15:25:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.653 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.649+0000 7fdaa6e4a640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.649+0000 7fdaa6e4a640 4 set_mon_vals no callback set 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.650+0000 7fdaa6e4a640 10 monclient: shutdown 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.650+0000 7fdaa6e4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.650+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/3787522996 >> v1:172.21.15.164:6789/0 conn(0x7fdaa00753d0 legacy=0x7fdaa013ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.650+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/3787522996 shutdown_connections 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.650+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/3787522996 >> 172.21.15.38:0/3787522996 conn(0x7fdaa00b5490 msgr2=0x7fdaa00b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.650+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/3787522996 shutdown_connections 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.650+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/3787522996 wait complete. 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.651+0000 7fdaa6e4a640 10 monclient: build_initial_monmap 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.651+0000 7fdaa6e4a640 10 monclient: monmap: 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:00.655 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:00.656 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.651+0000 7fdaa6e4a640 1 librados: starting msgr at 2024-04-15T15:25:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.651+0000 7fdaa6e4a640 1 librados: starting objecter 2024-04-15T15:25:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.651+0000 7fdaa6e4a640 1 Processor -- start 2024-04-15T15:25:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.651+0000 7fdaa6e4a640 1 -- start start 2024-04-15T15:25:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.651+0000 7fdaa6e4a640 1 librados: setting wanted keys 2024-04-15T15:25:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.651+0000 7fdaa6e4a640 1 librados: calling monclient init 2024-04-15T15:25:00.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.651+0000 7fdaa6e4a640 10 monclient: init 2024-04-15T15:25:00.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:00.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T15:25:00.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 10 monclient(hunting): picked mon.noname-c con 0x7fdaa00753d0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:00.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 10 monclient(hunting): picked mon.noname-a con 0x7fdaa00b0ac0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:00.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 10 monclient(hunting): picked mon.noname-b con 0x7fdaa0146b10 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:00.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa01474d0 con 0x7fdaa00b0ac0 2024-04-15T15:25:00.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa0142340 con 0x7fdaa0146b10 2024-04-15T15:25:00.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa0142620 con 0x7fdaa00753d0 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.652+0000 7fdaa6e4a640 10 monclient(hunting): authenticate will time out at 2960.923076s 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.653+0000 7fda97fff640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fdaa00b0ac0 0x7fdaa0144440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44304/0 (socket says 172.21.15.38:44304) 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.653+0000 7fda97fff640 1 -- 172.21.15.38:0/4191554276 learned_addr learned my addr 172.21.15.38:0/4191554276 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.653+0000 7fda957fa640 10 client.?.objecter ms_handle_connect 0x7fdaa00b0ac0 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.653+0000 7fda957fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.653+0000 7fda957fa640 10 client.?.objecter ms_handle_connect 0x7fdaa00753d0 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.653+0000 7fda957fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.653+0000 7fda957fa640 10 client.?.objecter ms_handle_connect 0x7fdaa0146b10 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.653+0000 7fda957fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769648657 0 0) 0x7fdaa0142620 con 0x7fdaa00753d0 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): my global_id is 81062 2024-04-15T15:25:00.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda8c004eb0 con 0x7fdaa00753d0 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084676933 0 0) 0x7fdaa0142340 con 0x7fdaa0146b10 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): my global_id is 32314 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa0142620 con 0x7fdaa0146b10 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1177166721 0 0) 0x7fdaa01474d0 con 0x7fdaa00b0ac0 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 10 monclient(hunting): my global_id is 33597 2024-04-15T15:25:00.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.655+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa0142340 con 0x7fdaa00b0ac0 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.659+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1530663126 0 0) 0x7fdaa0142620 con 0x7fdaa0146b10 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.659+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdaa01474d0 con 0x7fdaa0146b10 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.659+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda98001b90 con 0x7fdaa0146b10 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.659+0000 7fda957fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.659+0000 7fda957fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.659+0000 7fda957fa640 10 monclient(hunting): dump: 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.661 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.662 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.659+0000 7fda957fa640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.660+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1704256142 0 0) 0x7fda8c004eb0 con 0x7fdaa00753d0 2024-04-15T15:25:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.660+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdaa0142620 con 0x7fdaa00753d0 2024-04-15T15:25:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.660+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda9c001510 con 0x7fdaa00753d0 2024-04-15T15:25:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.660+0000 7fda957fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.660+0000 7fda957fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.660+0000 7fda957fa640 10 monclient(hunting): dump: 2024-04-15T15:25:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.663 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.661+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2995441293 0 0) 0x7fdaa0142340 con 0x7fdaa00b0ac0 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.661+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda8c004eb0 con 0x7fdaa00b0ac0 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.661+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda900017e0 con 0x7fdaa00b0ac0 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.661+0000 7fda957fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:00.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.661+0000 7fda957fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.661+0000 7fda957fa640 10 monclient(hunting): dump: 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.665 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3986238156 0 0) 0x7fdaa01474d0 con 0x7fdaa0146b10 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 >> v1:172.21.15.38:6790/0 conn(0x7fdaa00753d0 legacy=0x7fdaa0141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 >> v1:172.21.15.38:6789/0 conn(0x7fdaa00b0ac0 legacy=0x7fdaa0144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 10 monclient: _finish_hunting 0 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 1 monclient: found mon.b 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa0141840 con 0x7fdaa0146b10 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 10 monclient: _finish_auth 0 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 10 monclient: _check_auth_tickets 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fda957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fdaa6e4a640 5 monclient: authenticate success, global_id 32314 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fdaa6e4a640 10 monclient: _renew_subs 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fdaa6e4a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa0144b50 con 0x7fdaa0146b10 2024-04-15T15:25:00.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fdaa6e4a640 10 client.32314.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fdaa6e4a640 10 monclient: _renew_subs 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fdaa6e4a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdaa01e4860 con 0x7fdaa0146b10 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.663+0000 7fdaa6e4a640 1 librados: init done 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.664+0000 7fdaa6e4a640 10 client.32314.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.664+0000 7fdaa6e4a640 15 client.32314.objecter _session_command_op_assign -1 1 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.664+0000 7fdaa6e4a640 20 client.32314.objecter _get_session osd=-1 returning homeless 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.664+0000 7fdaa6e4a640 10 client.32314.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.664+0000 7fdaa6e4a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.664+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdaa0077050 con 0x7fdaa0146b10 2024-04-15T15:25:00.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.678+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdaa0077050 con 0x7fdaa0146b10 2024-04-15T15:25:00.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.678+0000 7fda957fa640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:00.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.678+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fda98004b60 con 0x7fdaa0146b10 2024-04-15T15:25:00.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.678+0000 7fda957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.678+0000 7fda957fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.678+0000 7fda957fa640 10 monclient: dump: 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.678+0000 7fda967fc640 4 set_mon_vals no callback set 2024-04-15T15:25:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.679+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fda9801b090 con 0x7fdaa0146b10 2024-04-15T15:25:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.679+0000 7fdaa4be6640 10 monclient: get_auth_request con 0x7fda8c06ef80 auth_method 0 2024-04-15T15:25:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.679+0000 7fda957fa640 10 client.32314.objecter ms_handle_connect 0x7fda8c06ef80 2024-04-15T15:25:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7fda980533b0 con 0x7fdaa0146b10 2024-04-15T15:25:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 10 client.32314.objecter ms_dispatch 0x7fdaa0000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:25:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 3 client.32314.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 3 client.32314.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 10 client.32314.objecter checking command 1 2024-04-15T15:25:00.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 20 client.32314.objecter _get_session s=0x7fda8c0772b0 osd=3 3 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 20 client.32314.objecter put_session s=0x7fda8c0772b0 osd=3 3 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 15 client.32314.objecter _session_command_op_remove -1 1 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 20 client.32314.objecter _get_session s=0x7fda8c0772b0 osd=3 3 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 20 client.32314.objecter get_session s=0x7fda8c0772b0 osd=3 3 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 15 client.32314.objecter _session_command_op_assign 3 1 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 20 client.32314.objecter put_session s=0x7fda8c0772b0 osd=3 4 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 10 client.32314.objecter _send_command 1 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.38:6813/2746933626 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda8c07b5d0 con 0x7fda8c077960 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.680+0000 7fda957fa640 20 client.32314.objecter dump_active .. 0 homeless 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.681+0000 7fda97fff640 10 monclient: get_auth_request con 0x7fda8c077960 auth_method 0 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.681+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=996) ==== 24+0+0 (unknown 3060284901 0 0) 0x7fda980512c0 con 0x7fdaa0146b10 2024-04-15T15:25:00.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.681+0000 7fda957fa640 10 monclient: handle_get_version_reply finishing 1 version 996 2024-04-15T15:25:00.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.682+0000 7fda957fa640 10 client.32314.objecter ms_handle_connect 0x7fda8c077960 2024-04-15T15:25:00.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.708+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== osd.3 v1:172.21.15.38:6813/2746933626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fda8c07b5d0 con 0x7fda8c077960 2024-04-15T15:25:00.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.708+0000 7fda957fa640 10 client.32314.objecter ms_dispatch 0x7fdaa0000b90 command_reply(tid 1: 0 ) 2024-04-15T15:25:00.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.708+0000 7fda957fa640 10 client.32314.objecter _finish_command 1 = system:0 2024-04-15T15:25:00.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.708+0000 7fda957fa640 20 client.32314.objecter put_session s=0x7fda8c0772b0 osd=3 4 2024-04-15T15:25:00.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.708+0000 7fda957fa640 15 client.32314.objecter _session_command_op_remove 3 1 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 10 client.32314.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 15 client.32314.objecter _session_command_op_assign -1 2 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 20 client.32314.objecter _get_session s=0x7fda8c0772b0 osd=3 3 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 20 client.32314.objecter put_session s=0x7fda8c0772b0 osd=3 3 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 20 client.32314.objecter _get_session s=0x7fda8c0772b0 osd=3 3 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 15 client.32314.objecter _session_command_op_remove -1 2 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 20 client.32314.objecter get_session s=0x7fda8c0772b0 osd=3 3 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 15 client.32314.objecter _session_command_op_assign 3 2 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 20 client.32314.objecter put_session s=0x7fda8c0772b0 osd=3 4 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 10 client.32314.objecter _send_command 2 2024-04-15T15:25:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.721+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 --> v1:172.21.15.38:6813/2746933626 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdaa014fc00 con 0x7fda8c077960 2024-04-15T15:25:00.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fda957fa640 1 -- 172.21.15.38:0/4191554276 <== osd.3 v1:172.21.15.38:6813/2746933626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fdaa014fc00 con 0x7fda8c077960 2024-04-15T15:25:00.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fda957fa640 10 client.32314.objecter ms_dispatch 0x7fdaa0000b90 command_reply(tid 2: 0 ) 2024-04-15T15:25:00.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fda957fa640 10 client.32314.objecter _finish_command 2 = system:0 2024-04-15T15:25:00.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fda957fa640 20 client.32314.objecter put_session s=0x7fda8c0772b0 osd=3 4 2024-04-15T15:25:00.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fda957fa640 15 client.32314.objecter _session_command_op_remove 3 2 2024-04-15T15:25:00.739 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-15T15:25:00.739 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:25:00.739 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-15T15:25:00.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 10 librados: watch_flush enter 2024-04-15T15:25:00.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 10 librados: watch_flush exit 2024-04-15T15:25:00.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 10 client.32314.objecter close_session for osd.3 2024-04-15T15:25:00.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 >> v1:172.21.15.38:6813/2746933626 conn(0x7fda8c077960 legacy=0x7fda8c079e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 20 client.32314.objecter put_session s=0x7fda8c0772b0 osd=3 1 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 20 client.32314.objecter shutdown clearing up homeless session... 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 10 client.32314.objecter successfully canceled tick 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 >> v1:172.21.15.38:6800/1608957829 conn(0x7fda8c06ef80 legacy=0x7fda8c071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 10 monclient: shutdown 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 >> v1:172.21.15.164:6789/0 conn(0x7fdaa0146b10 legacy=0x7fdaa01e2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa53e7640 1 -- 172.21.15.38:0/4191554276 reap_dead start 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 shutdown_connections 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.737+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 >> 172.21.15.38:0/4191554276 conn(0x7fdaa00b5490 msgr2=0x7fdaa013ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.738+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 shutdown_connections 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.738+0000 7fdaa6e4a640 1 -- 172.21.15.38:0/4191554276 wait complete. 2024-04-15T15:25:00.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.738+0000 7fdaa6e4a640 1 librados: shutdown 2024-04-15T15:25:00.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-15T15:25:00.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.857+0000 7f54f4752640 10 monclient: get_monmap_and_config 2024-04-15T15:25:00.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.857+0000 7f54f4752640 10 monclient: build_initial_monmap 2024-04-15T15:25:00.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.857+0000 7f54f4752640 10 monclient: monmap: 2024-04-15T15:25:00.859 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:00.859 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.859 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:00.858728+0000 2024-04-15T15:25:00.859 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:00.858728+0000 2024-04-15T15:25:00.860 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:00.860 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.860 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:00.860 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:00.860 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:00.860 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.858+0000 7f54f4752640 1 Processor -- start 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.858+0000 7f54f4752640 1 -- start start 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.858+0000 7f54f4752640 10 monclient: init 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 10 monclient(hunting): picked mon.noname-a con 0x7f54ec0b56f0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 10 monclient(hunting): picked mon.noname-c con 0x7f54ec140480 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 10 monclient(hunting): picked mon.noname-b con 0x7f54ec146dd0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ec0ac230 con 0x7f54ec0b56f0 2024-04-15T15:25:00.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ec0aac50 con 0x7f54ec140480 2024-04-15T15:25:00.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ec0ab170 con 0x7f54ec146dd0 2024-04-15T15:25:00.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:00.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.859+0000 7f54f4752640 10 monclient(hunting): authenticate will time out at 2961.129867s 2024-04-15T15:25:00.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.860+0000 7f54f24ee640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f54ec0b56f0 0x7f54ec0aa460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44314/0 (socket says 172.21.15.38:44314) 2024-04-15T15:25:00.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.860+0000 7f54f1ced640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f54ec140480 0x7f54ec1466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:52958/0 (socket says 172.21.15.38:52958) 2024-04-15T15:25:00.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.860+0000 7f54f24ee640 1 -- 172.21.15.38:0/1194768165 learned_addr learned my addr 172.21.15.38:0/1194768165 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:00.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3083662578 0 0) 0x7f54ec0aac50 con 0x7f54ec140480 2024-04-15T15:25:00.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 10 monclient(hunting): my global_id is 32317 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d4003520 con 0x7f54ec140480 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239670086 0 0) 0x7f54ec0ac230 con 0x7f54ec0b56f0 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 10 monclient(hunting): my global_id is 33600 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.862+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54ec0aac50 con 0x7f54ec0b56f0 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.863+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3662983698 0 0) 0x7f54ec0ab170 con 0x7f54ec146dd0 2024-04-15T15:25:00.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.863+0000 7f54f14ec640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.863+0000 7f54f14ec640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.863+0000 7f54f14ec640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.863+0000 7f54f14ec640 10 monclient(hunting): my global_id is 81065 2024-04-15T15:25:00.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.863+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54ec0ac230 con 0x7f54ec146dd0 2024-04-15T15:25:00.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2597242934 0 0) 0x7f54d4003520 con 0x7f54ec140480 2024-04-15T15:25:00.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 >> v1:172.21.15.38:6790/0 conn(0x7f54ec146dd0 legacy=0x7f54ec14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 >> v1:172.21.15.38:6789/0 conn(0x7f54ec0b56f0 legacy=0x7f54ec0aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 10 monclient: _finish_hunting 0 2024-04-15T15:25:00.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 1 monclient: found mon.noname-c 2024-04-15T15:25:00.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:00.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec0b5ad0 con 0x7f54ec140480 2024-04-15T15:25:00.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 10 monclient: _finish_auth 0 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 10 monclient: _check_auth_tickets 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f54e0001990 con 0x7f54ec140480 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f4752640 5 monclient: authenticate success, global_id 32317 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f4752640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f14ec640 10 monclient: dump: 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.868 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.869 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.869 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.869 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.869 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.869 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.869 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.869 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.869 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.865+0000 7f54f4752640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:00.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54e0001c60 con 0x7f54ec140480 2024-04-15T15:25:00.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f14ec640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f14ec640 1 -- 172.21.15.38:0/1194768165 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f54e0002030 con 0x7f54ec140480 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f14ec640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f14ec640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f14ec640 10 monclient: dump: 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.873 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f4752640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f4752640 4 set_mon_vals no callback set 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f4752640 10 monclient: shutdown 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f4752640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.867+0000 7f54f4752640 1 -- 172.21.15.38:0/1194768165 >> v1:172.21.15.164:6789/0 conn(0x7f54ec140480 legacy=0x7f54ec1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.868+0000 7f54f4752640 1 -- 172.21.15.38:0/1194768165 shutdown_connections 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.868+0000 7f54f4752640 1 -- 172.21.15.38:0/1194768165 >> 172.21.15.38:0/1194768165 conn(0x7f54ec067790 msgr2=0x7f54ec067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.868+0000 7f54f4752640 1 -- 172.21.15.38:0/1194768165 shutdown_connections 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.868+0000 7f54f4752640 1 -- 172.21.15.38:0/1194768165 wait complete. 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.868+0000 7f54f4752640 10 monclient: build_initial_monmap 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.868+0000 7f54f4752640 10 monclient: monmap: 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:00.875 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 1 librados: starting msgr at 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 1 librados: starting objecter 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 1 Processor -- start 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 1 -- start start 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 1 librados: setting wanted keys 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 1 librados: calling monclient init 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 10 monclient: init 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T15:25:00.876 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 10 monclient(hunting): picked mon.noname-c con 0x7f54ec0b56f0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 10 monclient(hunting): picked mon.noname-a con 0x7f54ec140480 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 10 monclient(hunting): picked mon.noname-b con 0x7f54ec146dd0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ec137f10 con 0x7f54ec140480 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ec144020 con 0x7f54ec146dd0 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ec1d92e0 con 0x7f54ec0b56f0 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.869+0000 7f54f4752640 10 monclient(hunting): authenticate will time out at 2961.140264s 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.870+0000 7f54f24ee640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f54ec0b56f0 0x7f54ec1d8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56164/0 (socket says 172.21.15.38:56164) 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.870+0000 7f54f24ee640 1 -- 172.21.15.38:0/1614871150 learned_addr learned my addr 172.21.15.38:0/1614871150 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.870+0000 7f54eaffd640 10 client.?.objecter ms_handle_connect 0x7f54ec146dd0 2024-04-15T15:25:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.870+0000 7f54eaffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.870+0000 7f54eaffd640 10 client.?.objecter ms_handle_connect 0x7f54ec0b56f0 2024-04-15T15:25:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.870+0000 7f54eaffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.870+0000 7f54eaffd640 10 client.?.objecter ms_handle_connect 0x7f54ec140480 2024-04-15T15:25:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.870+0000 7f54eaffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:00.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477657127 0 0) 0x7f54ec144020 con 0x7f54ec146dd0 2024-04-15T15:25:00.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 10 monclient(hunting): my global_id is 32320 2024-04-15T15:25:00.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d8004eb0 con 0x7f54ec146dd0 2024-04-15T15:25:00.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164712996 0 0) 0x7f54ec1d92e0 con 0x7f54ec0b56f0 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 10 monclient(hunting): my global_id is 81068 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.872+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54ec144020 con 0x7f54ec0b56f0 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.873+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934756340 0 0) 0x7f54ec137f10 con 0x7f54ec140480 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.873+0000 7f54eaffd640 10 monclient(hunting): _negotiate 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.873+0000 7f54eaffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.873+0000 7f54eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.873+0000 7f54eaffd640 10 monclient(hunting): my global_id is 33603 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.873+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54ec1d92e0 con 0x7f54ec140480 2024-04-15T15:25:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.877+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3776353342 0 0) 0x7f54d8004eb0 con 0x7f54ec146dd0 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.877+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54ec137f10 con 0x7f54ec146dd0 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.877+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f54dc001810 con 0x7f54ec146dd0 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.877+0000 7f54eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.877+0000 7f54eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.877+0000 7f54eaffd640 10 monclient(hunting): dump: 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.877+0000 7f54eaffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.878+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3377410671 0 0) 0x7f54ec144020 con 0x7f54ec0b56f0 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.878+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54d8004eb0 con 0x7f54ec0b56f0 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.878+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f54e40018b0 con 0x7f54ec0b56f0 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.878+0000 7f54eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.878+0000 7f54eaffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.878+0000 7f54eaffd640 10 monclient(hunting): dump: 2024-04-15T15:25:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.878+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1585626465 0 0) 0x7f54ec1d92e0 con 0x7f54ec140480 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.879+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54ec144020 con 0x7f54ec140480 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.879+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f54e0001890 con 0x7f54ec140480 2024-04-15T15:25:00.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.879+0000 7f54eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.879+0000 7f54eaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.879+0000 7f54eaffd640 10 monclient(hunting): dump: 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.885 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 917886019 0 0) 0x7f54ec137f10 con 0x7f54ec146dd0 2024-04-15T15:25:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 >> v1:172.21.15.38:6790/0 conn(0x7f54ec0b56f0 legacy=0x7f54ec1d8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 >> v1:172.21.15.38:6789/0 conn(0x7f54ec140480 legacy=0x7f54ec1d5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 10 monclient: _finish_hunting 0 2024-04-15T15:25:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 1 monclient: found mon.b 2024-04-15T15:25:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec1d5e30 con 0x7f54ec146dd0 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 10 monclient: _finish_auth 0 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 10 monclient: _check_auth_tickets 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54f4752640 5 monclient: authenticate success, global_id 32320 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54f4752640 10 monclient: _renew_subs 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54f4752640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec1d60c0 con 0x7f54ec146dd0 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54f4752640 10 client.32320.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54f4752640 10 monclient: _renew_subs 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54f4752640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f54ec1d51f0 con 0x7f54ec146dd0 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.881+0000 7f54f4752640 1 librados: init done 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.882+0000 7f54f4752640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:00.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.882+0000 7f54f4752640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:00.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.882+0000 7f54f4752640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:00.889 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.882+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ec077050 con 0x7f54ec146dd0 2024-04-15T15:25:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.896+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54dc003610 con 0x7f54ec146dd0 2024-04-15T15:25:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.896+0000 7f54eaffd640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.896+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f54dc0037c0 con 0x7f54ec146dd0 2024-04-15T15:25:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.896+0000 7f54eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.896+0000 7f54eaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.896+0000 7f54eaffd640 10 monclient: dump: 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.896+0000 7f54f0ceb640 4 set_mon_vals no callback set 2024-04-15T15:25:00.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.897+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f54dc019cf0 con 0x7f54ec146dd0 2024-04-15T15:25:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.898+0000 7f54f24ee640 10 monclient: get_auth_request con 0x7f54d806ef70 auth_method 0 2024-04-15T15:25:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.898+0000 7f54eaffd640 10 client.32320.objecter ms_handle_connect 0x7f54d806ef70 2024-04-15T15:25:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.899+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7f54dc051fa0 con 0x7f54ec146dd0 2024-04-15T15:25:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.899+0000 7f54eaffd640 10 client.32320.objecter ms_dispatch 0x7f54ec000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:25:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.899+0000 7f54eaffd640 3 client.32320.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.899+0000 7f54eaffd640 3 client.32320.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:00.899+0000 7f54eaffd640 20 client.32320.objecter dump_active .. 0 homeless 2024-04-15T15:25:01.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.152+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f54dc0543a0 con 0x7f54ec146dd0 2024-04-15T15:25:01.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.152+0000 7f54eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:01.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.152+0000 7f54eaffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:25:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.341+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f54ec137d50 con 0x7f54d806ef70 2024-04-15T15:25:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.341+0000 7f54eaffd640 1 -- 172.21.15.38:0/1614871150 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f54e4005880 con 0x7f54d806ef70 2024-04-15T15:25:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 3 to deep-scrub 2024-04-15T15:25:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 10 librados: watch_flush enter 2024-04-15T15:25:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 10 librados: watch_flush exit 2024-04-15T15:25:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 20 client.32320.objecter shutdown clearing up homeless session... 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 10 client.32320.objecter successfully canceled tick 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 >> v1:172.21.15.38:6800/1608957829 conn(0x7f54d806ef70 legacy=0x7f54d8071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 10 monclient: shutdown 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 >> v1:172.21.15.164:6789/0 conn(0x7f54ec146dd0 legacy=0x7f54ec1e3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 shutdown_connections 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.343+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 >> 172.21.15.38:0/1614871150 conn(0x7f54ec067790 msgr2=0x7f54ec14f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.344+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 shutdown_connections 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.344+0000 7f54f4752640 1 -- 172.21.15.38:0/1614871150 wait complete. 2024-04-15T15:25:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.344+0000 7f54f4752640 1 librados: shutdown 2024-04-15T15:25:01.356 INFO:tasks.ceph:Scrubbing osd.4 2024-04-15T15:25:01.356 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.463+0000 7fa356122640 10 monclient: get_monmap_and_config 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.463+0000 7fa356122640 10 monclient: build_initial_monmap 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.463+0000 7fa356122640 10 monclient: monmap: 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:01.464491+0000 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:01.464491+0000 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.465 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:01.466 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:01.466 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:01.466 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.464+0000 7fa356122640 1 Processor -- start 2024-04-15T15:25:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.464+0000 7fa356122640 1 -- start start 2024-04-15T15:25:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.464+0000 7fa356122640 10 monclient: init 2024-04-15T15:25:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T15:25:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 10 monclient(hunting): picked mon.noname-a con 0x7fa3500b5a20 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:01.467 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 10 monclient(hunting): picked mon.noname-b con 0x7fa35013cd80 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 10 monclient(hunting): picked mon.noname-c con 0x7fa35013d200 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35013d610 con 0x7fa3500b5a20 2024-04-15T15:25:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3500ac1c0 con 0x7fa35013d200 2024-04-15T15:25:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3500b5180 con 0x7fa35013cd80 2024-04-15T15:25:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa356122640 10 monclient(hunting): authenticate will time out at 2961.735589s 2024-04-15T15:25:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa34effd640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fa35013cd80 0x7fa350143590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56176/0 (socket says 172.21.15.38:56176) 2024-04-15T15:25:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa34effd640 1 -- 172.21.15.38:0/922027056 learned_addr learned my addr 172.21.15.38:0/922027056 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:01.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.465+0000 7fa34f7fe640 1 --1- 172.21.15.38:0/922027056 >> v1:172.21.15.38:6789/0 conn(0x7fa3500b5a20 0x7fa3500aa920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44334/0 (socket says 172.21.15.38:44334) 2024-04-15T15:25:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857700754 0 0) 0x7fa3500ac1c0 con 0x7fa35013d200 2024-04-15T15:25:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:01.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): my global_id is 32323 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa338003520 con 0x7fa35013d200 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854538355 0 0) 0x7fa3500b5180 con 0x7fa35013cd80 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): my global_id is 81071 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3500ac1c0 con 0x7fa35013cd80 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636644419 0 0) 0x7fa35013d610 con 0x7fa3500b5a20 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 10 monclient(hunting): my global_id is 33606 2024-04-15T15:25:01.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.468+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3500b5180 con 0x7fa3500b5a20 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2733419641 0 0) 0x7fa3500ac1c0 con 0x7fa35013cd80 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 >> v1:172.21.15.164:6789/0 conn(0x7fa35013d200 legacy=0x7fa35014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 >> v1:172.21.15.38:6789/0 conn(0x7fa3500b5a20 legacy=0x7fa3500aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 10 monclient: _finish_hunting 0 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 1 monclient: found mon.noname-b 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa350143ca0 con 0x7fa35013cd80 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 10 monclient: _finish_auth 0 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 10 monclient: _check_auth_tickets 2024-04-15T15:25:01.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa3440015f0 con 0x7fa35013cd80 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa34e7fc640 10 monclient: dump: 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.474 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa356122640 5 monclient: authenticate success, global_id 81071 2024-04-15T15:25:01.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.471+0000 7fa356122640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa344001850 con 0x7fa35013cd80 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa34e7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa34e7fc640 1 -- 172.21.15.38:0/922027056 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa344001ca0 con 0x7fa35013cd80 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa34e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa34e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa34e7fc640 10 monclient: dump: 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.477 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa356122640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa356122640 4 set_mon_vals no callback set 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa356122640 10 monclient: shutdown 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa356122640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa356122640 1 -- 172.21.15.38:0/922027056 >> v1:172.21.15.38:6790/0 conn(0x7fa35013cd80 legacy=0x7fa350143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa356122640 1 -- 172.21.15.38:0/922027056 shutdown_connections 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa356122640 1 -- 172.21.15.38:0/922027056 >> 172.21.15.38:0/922027056 conn(0x7fa350067790 msgr2=0x7fa350067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa356122640 1 -- 172.21.15.38:0/922027056 shutdown_connections 2024-04-15T15:25:01.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.473+0000 7fa356122640 1 -- 172.21.15.38:0/922027056 wait complete. 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.474+0000 7fa356122640 10 monclient: build_initial_monmap 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.474+0000 7fa356122640 10 monclient: monmap: 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.474+0000 7fa356122640 1 librados: starting msgr at 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.474+0000 7fa356122640 1 librados: starting objecter 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.474+0000 7fa356122640 1 Processor -- start 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 1 -- start start 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 1 librados: setting wanted keys 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 1 librados: calling monclient init 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 10 monclient: init 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 10 monclient(hunting): picked mon.noname-b con 0x7fa3500b5a20 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 10 monclient(hunting): picked mon.noname-a con 0x7fa35013cd80 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 10 monclient(hunting): picked mon.noname-c con 0x7fa35013d200 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa350137880 con 0x7fa35013cd80 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35013c920 con 0x7fa3500b5a20 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35013c420 con 0x7fa35013d200 2024-04-15T15:25:01.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:01.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.475+0000 7fa356122640 10 monclient(hunting): authenticate will time out at 2961.746132s 2024-04-15T15:25:01.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.476+0000 7fa34effd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa35013cd80 0x7fa350136a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44338/0 (socket says 172.21.15.38:44338) 2024-04-15T15:25:01.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.476+0000 7fa34effd640 1 -- 172.21.15.38:0/4077102409 learned_addr learned my addr 172.21.15.38:0/4077102409 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.476+0000 7fa337fff640 10 client.?.objecter ms_handle_connect 0x7fa35013cd80 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.476+0000 7fa337fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.476+0000 7fa337fff640 10 client.?.objecter ms_handle_connect 0x7fa35013d200 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.476+0000 7fa337fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.476+0000 7fa337fff640 10 client.?.objecter ms_handle_connect 0x7fa3500b5a20 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.476+0000 7fa337fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577512422 0 0) 0x7fa35013c420 con 0x7fa35013d200 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:01.482 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): my global_id is 81074 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa33c004eb0 con 0x7fa35013d200 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469845270 0 0) 0x7fa35013c920 con 0x7fa3500b5a20 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): my global_id is 32326 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35013c420 con 0x7fa3500b5a20 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118547830 0 0) 0x7fa350137880 con 0x7fa35013cd80 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 10 monclient(hunting): my global_id is 33609 2024-04-15T15:25:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.478+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35013c920 con 0x7fa35013cd80 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 997216531 0 0) 0x7fa33c004eb0 con 0x7fa35013d200 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa350137880 con 0x7fa35013d200 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa3480019c0 con 0x7fa35013d200 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): dump: 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.485 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 576703136 0 0) 0x7fa35013c420 con 0x7fa3500b5a20 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa33c004eb0 con 0x7fa3500b5a20 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa3400019d0 con 0x7fa3500b5a20 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): dump: 2024-04-15T15:25:01.486 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4125531158 0 0) 0x7fa35013c920 con 0x7fa35013cd80 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa35013c420 con 0x7fa35013cd80 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa3440047e0 con 0x7fa35013cd80 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.483+0000 7fa337fff640 10 monclient(hunting): dump: 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.488 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1203045897 0 0) 0x7fa350137880 con 0x7fa35013d200 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 >> v1:172.21.15.164:6789/0 conn(0x7fa3500b5a20 legacy=0x7fa3501db720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 >> v1:172.21.15.38:6789/0 conn(0x7fa35013cd80 legacy=0x7fa350136a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 10 monclient: _finish_hunting 0 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 1 monclient: found mon.c 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3500b1a70 con 0x7fa35013d200 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 10 monclient: _finish_auth 0 2024-04-15T15:25:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 10 monclient: _check_auth_tickets 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa337fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 5 monclient: authenticate success, global_id 81074 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 10 monclient: _renew_subs 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3500b1d60 con 0x7fa35013d200 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 10 client.81074.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 10 monclient: _renew_subs 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa35013fd60 con 0x7fa35013d200 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 1 librados: init done 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 10 client.81074.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 15 client.81074.objecter _session_command_op_assign -1 1 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 20 client.81074.objecter _get_session osd=-1 returning homeless 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 10 client.81074.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.487+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.38:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa350077050 con 0x7fa35013d200 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.503+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa350077050 con 0x7fa35013d200 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.503+0000 7fa337fff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.503+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fa348003970 con 0x7fa35013d200 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.503+0000 7fa337fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.503+0000 7fa337fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.503+0000 7fa337fff640 10 monclient: dump: 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.506 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.506 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.506 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.506 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.506 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.503+0000 7fa34dffb640 4 set_mon_vals no callback set 2024-04-15T15:25:01.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.504+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fa348019ea0 con 0x7fa35013d200 2024-04-15T15:25:01.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.505+0000 7fa34f7fe640 10 monclient: get_auth_request con 0x7fa33c06efc0 auth_method 0 2024-04-15T15:25:01.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.505+0000 7fa337fff640 10 client.81074.objecter ms_handle_connect 0x7fa33c06efc0 2024-04-15T15:25:01.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7fa348052040 con 0x7fa35013d200 2024-04-15T15:25:01.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 10 client.81074.objecter ms_dispatch 0x7fa350000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:25:01.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 3 client.81074.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:01.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 3 client.81074.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:01.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 10 client.81074.objecter checking command 1 2024-04-15T15:25:01.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 20 client.81074.objecter _get_session s=0x7fa33c0772f0 osd=4 3 2024-04-15T15:25:01.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 20 client.81074.objecter put_session s=0x7fa33c0772f0 osd=4 3 2024-04-15T15:25:01.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 15 client.81074.objecter _session_command_op_remove -1 1 2024-04-15T15:25:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 20 client.81074.objecter _get_session s=0x7fa33c0772f0 osd=4 3 2024-04-15T15:25:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 20 client.81074.objecter get_session s=0x7fa33c0772f0 osd=4 3 2024-04-15T15:25:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 15 client.81074.objecter _session_command_op_assign 4 1 2024-04-15T15:25:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 20 client.81074.objecter put_session s=0x7fa33c0772f0 osd=4 4 2024-04-15T15:25:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 10 client.81074.objecter _send_command 1 2024-04-15T15:25:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.164:6812/1135451953 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa33c07b610 con 0x7fa33c0779a0 2024-04-15T15:25:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.506+0000 7fa337fff640 20 client.81074.objecter dump_active .. 0 homeless 2024-04-15T15:25:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.507+0000 7fa34effd640 10 monclient: get_auth_request con 0x7fa33c0779a0 auth_method 0 2024-04-15T15:25:01.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.509+0000 7fa337fff640 10 client.81074.objecter ms_handle_connect 0x7fa33c0779a0 2024-04-15T15:25:01.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.509+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_get_version_reply(handle=1 version=996) ==== 24+0+0 (unknown 3060284901 0 0) 0x7fa34804ff50 con 0x7fa35013d200 2024-04-15T15:25:01.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.509+0000 7fa337fff640 10 monclient: handle_get_version_reply finishing 1 version 996 2024-04-15T15:25:01.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.533+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== osd.4 v1:172.21.15.164:6812/1135451953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fa33c07b610 con 0x7fa33c0779a0 2024-04-15T15:25:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.533+0000 7fa337fff640 10 client.81074.objecter ms_dispatch 0x7fa350000b90 command_reply(tid 1: 0 ) 2024-04-15T15:25:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.533+0000 7fa337fff640 10 client.81074.objecter _finish_command 1 = system:0 2024-04-15T15:25:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.533+0000 7fa337fff640 20 client.81074.objecter put_session s=0x7fa33c0772f0 osd=4 4 2024-04-15T15:25:01.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.533+0000 7fa337fff640 15 client.81074.objecter _session_command_op_remove 4 1 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 10 client.81074.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 15 client.81074.objecter _session_command_op_assign -1 2 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 20 client.81074.objecter _get_session s=0x7fa33c0772f0 osd=4 3 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 20 client.81074.objecter put_session s=0x7fa33c0772f0 osd=4 3 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 20 client.81074.objecter _get_session s=0x7fa33c0772f0 osd=4 3 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 15 client.81074.objecter _session_command_op_remove -1 2 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 20 client.81074.objecter get_session s=0x7fa33c0772f0 osd=4 3 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 15 client.81074.objecter _session_command_op_assign 4 2 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 20 client.81074.objecter put_session s=0x7fa33c0772f0 osd=4 4 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 10 client.81074.objecter _send_command 2 2024-04-15T15:25:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.546+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 --> v1:172.21.15.164:6812/1135451953 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa3500b8440 con 0x7fa33c0779a0 2024-04-15T15:25:01.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa337fff640 1 -- 172.21.15.38:0/4077102409 <== osd.4 v1:172.21.15.164:6812/1135451953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fa3500b8440 con 0x7fa33c0779a0 2024-04-15T15:25:01.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa337fff640 10 client.81074.objecter ms_dispatch 0x7fa350000b90 command_reply(tid 2: 0 ) 2024-04-15T15:25:01.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa337fff640 10 client.81074.objecter _finish_command 2 = system:0 2024-04-15T15:25:01.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa337fff640 20 client.81074.objecter put_session s=0x7fa33c0772f0 osd=4 4 2024-04-15T15:25:01.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa337fff640 15 client.81074.objecter _session_command_op_remove 4 2 2024-04-15T15:25:01.562 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-15T15:25:01.562 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:25:01.562 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-15T15:25:01.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 10 librados: watch_flush enter 2024-04-15T15:25:01.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 10 librados: watch_flush exit 2024-04-15T15:25:01.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 10 client.81074.objecter close_session for osd.4 2024-04-15T15:25:01.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 >> v1:172.21.15.164:6812/1135451953 conn(0x7fa33c0779a0 legacy=0x7fa33c079e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 20 client.81074.objecter put_session s=0x7fa33c0772f0 osd=4 1 2024-04-15T15:25:01.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 20 client.81074.objecter shutdown clearing up homeless session... 2024-04-15T15:25:01.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 10 client.81074.objecter successfully canceled tick 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 >> v1:172.21.15.38:6800/1608957829 conn(0x7fa33c06efc0 legacy=0x7fa33c071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 10 monclient: shutdown 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 >> v1:172.21.15.38:6790/0 conn(0x7fa35013d200 legacy=0x7fa350137170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa34ffff640 1 -- 172.21.15.38:0/4077102409 reap_dead start 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 shutdown_connections 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 >> 172.21.15.38:0/4077102409 conn(0x7fa350067790 msgr2=0x7fa3500b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 shutdown_connections 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.560+0000 7fa356122640 1 -- 172.21.15.38:0/4077102409 wait complete. 2024-04-15T15:25:01.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.561+0000 7fa356122640 1 librados: shutdown 2024-04-15T15:25:01.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-15T15:25:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.680+0000 7f777b359640 10 monclient: get_monmap_and_config 2024-04-15T15:25:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.680+0000 7f777b359640 10 monclient: build_initial_monmap 2024-04-15T15:25:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.680+0000 7f777b359640 10 monclient: monmap: 2024-04-15T15:25:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:01.680891+0000 2024-04-15T15:25:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:01.680891+0000 2024-04-15T15:25:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:01.682 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.680+0000 7f777b359640 1 Processor -- start 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.680+0000 7f777b359640 1 -- start start 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.680+0000 7f777b359640 10 monclient: init 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 10 monclient(hunting): picked mon.noname-b con 0x7f77740b57d0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 10 monclient(hunting): picked mon.noname-c con 0x7f77740b5bb0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 10 monclient(hunting): picked mon.noname-a con 0x7f7774140b30 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7774146e10 con 0x7f7774140b30 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77740aa840 con 0x7f77740b5bb0 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77740aa460 con 0x7f77740b57d0 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.681+0000 7f777b359640 10 monclient(hunting): authenticate will time out at 2961.952026s 2024-04-15T15:25:01.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.684+0000 7f77788f4640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f77740b5bb0 0x7f7774140420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:53004/0 (socket says 172.21.15.38:53004) 2024-04-15T15:25:01.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.684+0000 7f77788f4640 1 -- 172.21.15.38:0/3994734832 learned_addr learned my addr 172.21.15.38:0/3994734832 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:01.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.695+0000 7f776bfff640 1 -- 172.21.15.38:0/3994734832 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333029028 0 0) 0x7f77740aa840 con 0x7f77740b5bb0 2024-04-15T15:25:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.695+0000 7f776bfff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.695+0000 7f776bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.695+0000 7f776bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.695+0000 7f776bfff640 10 monclient(hunting): my global_id is 32329 2024-04-15T15:25:01.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.695+0000 7f776bfff640 1 -- 172.21.15.38:0/3994734832 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7760003520 con 0x7f77740b5bb0 2024-04-15T15:25:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 1 -- 172.21.15.38:0/3994734832 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4224569677 0 0) 0x7f7760003520 con 0x7f77740b5bb0 2024-04-15T15:25:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 1 -- 172.21.15.38:0/3994734832 >> v1:172.21.15.38:6790/0 conn(0x7f77740b57d0 legacy=0x7f7774146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:25:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 1 -- 172.21.15.38:0/3994734832 >> v1:172.21.15.38:6789/0 conn(0x7f7774140b30 legacy=0x7f777414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:25:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 10 monclient: _finish_hunting 0 2024-04-15T15:25:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 1 monclient: found mon.noname-c 2024-04-15T15:25:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:01.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 1 -- 172.21.15.38:0/3994734832 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77740b2970 con 0x7f77740b5bb0 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 10 monclient: _finish_auth 0 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 10 monclient: _check_auth_tickets 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f777b359640 5 monclient: authenticate success, global_id 32329 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f777b359640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 1 -- 172.21.15.38:0/3994734832 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7764001610 con 0x7f77740b5bb0 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f776bfff640 10 monclient: dump: 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.701 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.702 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.698+0000 7f777b359640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:01.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.700+0000 7f776bfff640 1 -- 172.21.15.38:0/3994734832 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77640018e0 con 0x7f77740b5bb0 2024-04-15T15:25:01.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.700+0000 7f776bfff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:01.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.700+0000 7f777b359640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:01.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.700+0000 7f776bfff640 1 -- 172.21.15.38:0/3994734832 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7764001d30 con 0x7f77740b5bb0 2024-04-15T15:25:01.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.700+0000 7f777b359640 4 set_mon_vals no callback set 2024-04-15T15:25:01.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.700+0000 7f776bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:01.705 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.700+0000 7f776bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.700+0000 7f776bfff640 10 monclient: dump: 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.701+0000 7f777b359640 10 monclient: shutdown 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.701+0000 7f777b359640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.701+0000 7f777b359640 1 -- 172.21.15.38:0/3994734832 >> v1:172.21.15.164:6789/0 conn(0x7f77740b5bb0 legacy=0x7f7774140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.701+0000 7f777b359640 1 -- 172.21.15.38:0/3994734832 shutdown_connections 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.701+0000 7f777b359640 1 -- 172.21.15.38:0/3994734832 >> 172.21.15.38:0/3994734832 conn(0x7f7774067790 msgr2=0x7f7774067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.701+0000 7f777b359640 1 -- 172.21.15.38:0/3994734832 shutdown_connections 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.701+0000 7f777b359640 1 -- 172.21.15.38:0/3994734832 wait complete. 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.702+0000 7f777b359640 10 monclient: build_initial_monmap 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.702+0000 7f777b359640 10 monclient: monmap: 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:01.707 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.702+0000 7f777b359640 1 librados: starting msgr at 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.702+0000 7f777b359640 1 librados: starting objecter 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.702+0000 7f777b359640 1 Processor -- start 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.702+0000 7f777b359640 1 -- start start 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.702+0000 7f777b359640 1 librados: setting wanted keys 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.702+0000 7f777b359640 1 librados: calling monclient init 2024-04-15T15:25:01.708 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.702+0000 7f777b359640 10 monclient: init 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 10 monclient(hunting): picked mon.noname-b con 0x7f77740b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 10 monclient(hunting): picked mon.noname-a con 0x7f77740b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 10 monclient(hunting): picked mon.noname-c con 0x7f7774140b30 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77740ae3f0 con 0x7f77740b5bb0 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77740ae6d0 con 0x7f77740b57d0 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7774143ea0 con 0x7f7774140b30 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.703+0000 7f777b359640 10 monclient(hunting): authenticate will time out at 2961.973877s 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.704+0000 7f77790f5640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f77740b57d0 0x7f7774139090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:53018/0 (socket says 172.21.15.38:53018) 2024-04-15T15:25:01.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.704+0000 7f77790f5640 1 -- 172.21.15.38:0/3757705685 learned_addr learned my addr 172.21.15.38:0/3757705685 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:01.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.704+0000 7f7769ffb640 10 client.?.objecter ms_handle_connect 0x7f77740b57d0 2024-04-15T15:25:01.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.704+0000 7f7769ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:01.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.705+0000 7f7769ffb640 10 client.?.objecter ms_handle_connect 0x7f7774140b30 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.705+0000 7f7769ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.706+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402828380 0 0) 0x7f77740ae6d0 con 0x7f77740b57d0 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.706+0000 7f7769ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.706+0000 7f7769ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.706+0000 7f7769ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.706+0000 7f7769ffb640 10 monclient(hunting): my global_id is 32332 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.706+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7758004eb0 con 0x7f77740b57d0 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.707+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826488328 0 0) 0x7f7774143ea0 con 0x7f7774140b30 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.707+0000 7f7769ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.707+0000 7f7769ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.707+0000 7f7769ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:01.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.707+0000 7f7769ffb640 10 monclient(hunting): my global_id is 81077 2024-04-15T15:25:01.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.707+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77740ae6d0 con 0x7f7774140b30 2024-04-15T15:25:01.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.711+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4270779169 0 0) 0x7f7758004eb0 con 0x7f77740b57d0 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.711+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7774143ea0 con 0x7f77740b57d0 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.711+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7770004000 con 0x7f77740b57d0 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.711+0000 7f7769ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.711+0000 7f7769ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.711+0000 7f7769ffb640 10 monclient(hunting): dump: 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.713 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.714 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.714 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.714 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.711+0000 7f7769ffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:01.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.712+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4050102803 0 0) 0x7f77740ae6d0 con 0x7f7774140b30 2024-04-15T15:25:01.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.712+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7758004eb0 con 0x7f7774140b30 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.712+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f776c001a50 con 0x7f7774140b30 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.712+0000 7f7769ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.712+0000 7f7769ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.712+0000 7f7769ffb640 10 monclient(hunting): dump: 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.715 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.716 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.716 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2911531486 0 0) 0x7f7774143ea0 con 0x7f77740b57d0 2024-04-15T15:25:01.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 >> v1:172.21.15.38:6790/0 conn(0x7f7774140b30 legacy=0x7f77741dc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 >> v1:172.21.15.38:6789/0 conn(0x7f77740b5bb0 legacy=0x7f77741dbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:01.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 10 monclient: _finish_hunting 0 2024-04-15T15:25:01.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 1 monclient: found mon.b 2024-04-15T15:25:01.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:01.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:01.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77740ac8c0 con 0x7f77740b57d0 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 10 monclient: _finish_auth 0 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f7769ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f777b359640 5 monclient: authenticate success, global_id 32332 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f777b359640 10 monclient: _renew_subs 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f777b359640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f77740acbb0 con 0x7f77740b57d0 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f777b359640 10 client.32332.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f777b359640 10 monclient: _renew_subs 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f777b359640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7774139980 con 0x7f77740b57d0 2024-04-15T15:25:01.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.714+0000 7f777b359640 1 librados: init done 2024-04-15T15:25:01.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.715+0000 7f777b359640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:01.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.715+0000 7f777b359640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:01.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.715+0000 7f777b359640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:01.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.715+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7774143c90 con 0x7f77740b57d0 2024-04-15T15:25:01.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.965+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7770000ed0 con 0x7f77740b57d0 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.965+0000 7f7769ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.965+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7770001220 con 0x7f77740b57d0 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.965+0000 7f7769ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.965+0000 7f7769ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.965+0000 7f7769ffb640 10 monclient: dump: 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:01.968 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.965+0000 7f776b7fe640 4 set_mon_vals no callback set 2024-04-15T15:25:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.966+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f77700013c0 con 0x7f77740b57d0 2024-04-15T15:25:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.966+0000 7f77788f4640 10 monclient: get_auth_request con 0x7f775806ed80 auth_method 0 2024-04-15T15:25:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.966+0000 7f7769ffb640 10 client.32332.objecter ms_handle_connect 0x7f775806ed80 2024-04-15T15:25:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.970+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 501..996) ==== 5226+0+0 (unknown 2061756143 0 0) 0x7f7770053440 con 0x7f77740b57d0 2024-04-15T15:25:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.970+0000 7f7769ffb640 10 client.32332.objecter ms_dispatch 0x7f7774000b90 osd_map(996..996 src has 501..996) 2024-04-15T15:25:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.970+0000 7f7769ffb640 3 client.32332.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.970+0000 7f7769ffb640 3 client.32332.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.970+0000 7f7769ffb640 20 client.32332.objecter dump_active .. 0 homeless 2024-04-15T15:25:01.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.972+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f7770055840 con 0x7f77740b57d0 2024-04-15T15:25:01.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.972+0000 7f7769ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:01.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:01.972+0000 7f7769ffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:25:02.033 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:39.875 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:02.038 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:39.880 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:02.053 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:39.896 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:02.090 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:39.881 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:02.097 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:39.888 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:02.110 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:39.953 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:02.111 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:39.954 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:02.113 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:39.903 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:02.129 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:39.972 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.185+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f7774077050 con 0x7f775806ed80 2024-04-15T15:25:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.185+0000 7f7769ffb640 1 -- 172.21.15.38:0/3757705685 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f7774077050 con 0x7f775806ed80 2024-04-15T15:25:02.186 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 4 to deep-scrub 2024-04-15T15:25:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 10 librados: watch_flush enter 2024-04-15T15:25:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 10 librados: watch_flush exit 2024-04-15T15:25:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 20 client.32332.objecter shutdown clearing up homeless session... 2024-04-15T15:25:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 10 client.32332.objecter successfully canceled tick 2024-04-15T15:25:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 >> v1:172.21.15.38:6800/1608957829 conn(0x7f775806ed80 legacy=0x7f7758071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 10 monclient: shutdown 2024-04-15T15:25:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:02.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 >> v1:172.21.15.164:6789/0 conn(0x7f77740b57d0 legacy=0x7f7774139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 shutdown_connections 2024-04-15T15:25:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 >> 172.21.15.38:0/3757705685 conn(0x7f7774067790 msgr2=0x7f7774067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 shutdown_connections 2024-04-15T15:25:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 1 -- 172.21.15.38:0/3757705685 wait complete. 2024-04-15T15:25:02.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.187+0000 7f777b359640 1 librados: shutdown 2024-04-15T15:25:02.202 INFO:tasks.ceph:Scrubbing osd.5 2024-04-15T15:25:02.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:25:02.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.332+0000 7fe871332640 10 monclient: get_monmap_and_config 2024-04-15T15:25:02.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.332+0000 7fe871332640 10 monclient: build_initial_monmap 2024-04-15T15:25:02.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.332+0000 7fe871332640 10 monclient: monmap: 2024-04-15T15:25:02.334 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:02.334 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.334 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:02.333497+0000 2024-04-15T15:25:02.334 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:02.333497+0000 2024-04-15T15:25:02.335 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:02.335 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.335 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:02.335 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:02.335 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:02.335 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.333+0000 7fe871332640 1 Processor -- start 2024-04-15T15:25:02.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.333+0000 7fe871332640 1 -- start start 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.333+0000 7fe871332640 10 monclient: init 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 10 monclient(hunting): picked mon.noname-c con 0x7fe86c0b56d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 10 monclient(hunting): picked mon.noname-b con 0x7fe86c0b5ab0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 10 monclient(hunting): picked mon.noname-a con 0x7fe86c14caf0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0af530 con 0x7fe86c14caf0 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0af810 con 0x7fe86c0b56d0 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c09ee60 con 0x7fe86c0b5ab0 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:02.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.334+0000 7fe871332640 10 monclient(hunting): authenticate will time out at 2962.604832s 2024-04-15T15:25:02.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.339+0000 7fe863fff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fe86c0b5ab0 0x7fe86c143930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:56210/0 (socket says 172.21.15.38:56210) 2024-04-15T15:25:02.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.339+0000 7fe863fff640 1 -- 172.21.15.38:0/1334050665 learned_addr learned my addr 172.21.15.38:0/1334050665 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:02.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.362+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289723915 0 0) 0x7fe86c0af530 con 0x7fe86c14caf0 2024-04-15T15:25:02.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.362+0000 7fe86a7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.362+0000 7fe86a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.362+0000 7fe86a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.362+0000 7fe86a7fc640 10 monclient(hunting): my global_id is 33612 2024-04-15T15:25:02.364 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.362+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe858003520 con 0x7fe86c14caf0 2024-04-15T15:25:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.366+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2971000841 0 0) 0x7fe86c0af810 con 0x7fe86c0b56d0 2024-04-15T15:25:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.366+0000 7fe86a7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.366+0000 7fe86a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.366+0000 7fe86a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.366+0000 7fe86a7fc640 10 monclient(hunting): my global_id is 32335 2024-04-15T15:25:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.366+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe86c0af530 con 0x7fe86c0b56d0 2024-04-15T15:25:02.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.369+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645806780 0 0) 0x7fe86c09ee60 con 0x7fe86c0b5ab0 2024-04-15T15:25:02.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.369+0000 7fe86a7fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.369+0000 7fe86a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.369+0000 7fe86a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.369+0000 7fe86a7fc640 10 monclient(hunting): my global_id is 81080 2024-04-15T15:25:02.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.369+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe86c0af810 con 0x7fe86c0b5ab0 2024-04-15T15:25:02.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3027820365 0 0) 0x7fe858003520 con 0x7fe86c14caf0 2024-04-15T15:25:02.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 >> v1:172.21.15.38:6790/0 conn(0x7fe86c0b5ab0 legacy=0x7fe86c143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 >> v1:172.21.15.164:6789/0 conn(0x7fe86c0b56d0 legacy=0x7fe86c0add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 10 monclient: _finish_hunting 0 2024-04-15T15:25:02.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 1 monclient: found mon.noname-a 2024-04-15T15:25:02.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:02.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c0b4ca0 con 0x7fe86c14caf0 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 10 monclient: _finish_auth 0 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 10 monclient: _check_auth_tickets 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe864001990 con 0x7fe86c14caf0 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe86a7fc640 10 monclient: dump: 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:02.378 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe871332640 5 monclient: authenticate success, global_id 33612 2024-04-15T15:25:02.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.375+0000 7fe871332640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe864001bf0 con 0x7fe86c14caf0 2024-04-15T15:25:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe86a7fc640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe86a7fc640 1 -- 172.21.15.38:0/1334050665 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe864001f40 con 0x7fe86c14caf0 2024-04-15T15:25:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe86a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe86a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:02.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe86a7fc640 10 monclient: dump: 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe871332640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:02.392 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe871332640 4 set_mon_vals no callback set 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe871332640 10 monclient: shutdown 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe871332640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe871332640 1 -- 172.21.15.38:0/1334050665 >> v1:172.21.15.38:6789/0 conn(0x7fe86c14caf0 legacy=0x7fe86c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe871332640 1 -- 172.21.15.38:0/1334050665 shutdown_connections 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe871332640 1 -- 172.21.15.38:0/1334050665 >> 172.21.15.38:0/1334050665 conn(0x7fe86c06cc50 msgr2=0x7fe86c067790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.390+0000 7fe871332640 1 -- 172.21.15.38:0/1334050665 shutdown_connections 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.391+0000 7fe871332640 1 -- 172.21.15.38:0/1334050665 wait complete. 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.391+0000 7fe871332640 10 monclient: build_initial_monmap 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.391+0000 7fe871332640 10 monclient: monmap: 2024-04-15T15:25:02.395 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.391+0000 7fe871332640 1 librados: starting msgr at 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.391+0000 7fe871332640 1 librados: starting objecter 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 1 Processor -- start 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 1 -- start start 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 1 librados: setting wanted keys 2024-04-15T15:25:02.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 1 librados: calling monclient init 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 10 monclient: init 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 10 monclient(hunting): picked mon.noname-c con 0x7fe86c0b56d0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 10 monclient(hunting): picked mon.noname-b con 0x7fe86c14caf0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 10 monclient(hunting): picked mon.noname-a con 0x7fe86c09d0f0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c146e00 con 0x7fe86c09d0f0 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c1470e0 con 0x7fe86c14caf0 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c1445c0 con 0x7fe86c0b56d0 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.392+0000 7fe871332640 10 monclient(hunting): authenticate will time out at 2962.663156s 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.393+0000 7fe86b7fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe86c09d0f0 0x7fe86c1e4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44382/0 (socket says 172.21.15.38:44382) 2024-04-15T15:25:02.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.393+0000 7fe86b7fe640 1 -- 172.21.15.38:0/3783040523 learned_addr learned my addr 172.21.15.38:0/3783040523 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.396+0000 7fe8637fe640 10 client.?.objecter ms_handle_connect 0x7fe86c09d0f0 2024-04-15T15:25:02.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.396+0000 7fe8637fe640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:02.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.405+0000 7fe8637fe640 10 client.?.objecter ms_handle_connect 0x7fe86c0b56d0 2024-04-15T15:25:02.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.405+0000 7fe8637fe640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:02.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.407+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14325088 0 0) 0x7fe86c146e00 con 0x7fe86c09d0f0 2024-04-15T15:25:02.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.407+0000 7fe8637fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.407+0000 7fe8637fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.407+0000 7fe8637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.407+0000 7fe8637fe640 10 monclient(hunting): my global_id is 33615 2024-04-15T15:25:02.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.407+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe84c004eb0 con 0x7fe86c09d0f0 2024-04-15T15:25:02.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.415+0000 7fe8637fe640 10 client.?.objecter ms_handle_connect 0x7fe86c14caf0 2024-04-15T15:25:02.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.415+0000 7fe8637fe640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:02.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.416+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 463706058 0 0) 0x7fe84c004eb0 con 0x7fe86c09d0f0 2024-04-15T15:25:02.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.416+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe86c146e00 con 0x7fe86c09d0f0 2024-04-15T15:25:02.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.416+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe864001890 con 0x7fe86c09d0f0 2024-04-15T15:25:02.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.416+0000 7fe8637fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.416+0000 7fe8637fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.416+0000 7fe8637fe640 10 monclient(hunting): dump: 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.416+0000 7fe8637fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:02.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.420+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3531873092 0 0) 0x7fe86c1470e0 con 0x7fe86c14caf0 2024-04-15T15:25:02.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.420+0000 7fe8637fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.420+0000 7fe8637fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.420+0000 7fe8637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.420+0000 7fe8637fe640 10 monclient(hunting): my global_id is 32338 2024-04-15T15:25:02.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.420+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe84c004eb0 con 0x7fe86c14caf0 2024-04-15T15:25:02.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 113735366 0 0) 0x7fe86c146e00 con 0x7fe86c09d0f0 2024-04-15T15:25:02.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 >> v1:172.21.15.38:6790/0 conn(0x7fe86c0b56d0 legacy=0x7fe86c09c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 >> v1:172.21.15.164:6789/0 conn(0x7fe86c14caf0 legacy=0x7fe86c138f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 10 monclient: _finish_hunting 0 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 1 monclient: found mon.a 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c1460d0 con 0x7fe86c09d0f0 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 10 monclient: _finish_auth 0 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 10 monclient: _check_auth_tickets 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe8637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe871332640 5 monclient: authenticate success, global_id 33615 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe871332640 10 monclient: _renew_subs 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe871332640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.428+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c145600 con 0x7fe86c09d0f0 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 10 client.33615.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 10 monclient: _renew_subs 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe86c144f60 con 0x7fe86c09d0f0 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 1 librados: init done 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 10 client.33615.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 15 client.33615.objecter _session_command_op_assign -1 1 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 20 client.33615.objecter _get_session osd=-1 returning homeless 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 10 client.33615.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.429+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 --> v1:172.21.15.38:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe86c077050 con 0x7fe86c09d0f0 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.470+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe86c077050 con 0x7fe86c09d0f0 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.470+0000 7fe8637fe640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.470+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe864001bc0 con 0x7fe86c09d0f0 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.470+0000 7fe8637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.470+0000 7fe8637fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.470+0000 7fe8637fe640 10 monclient: dump: 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.472 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:02.473 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.473 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:02.473 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:02.473 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:02.473 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.470+0000 7fe869ffb640 4 set_mon_vals no callback set 2024-04-15T15:25:02.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.471+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fe864003ca0 con 0x7fe86c09d0f0 2024-04-15T15:25:02.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.472+0000 7fe86affd640 10 monclient: get_auth_request con 0x7fe84c06ee60 auth_method 0 2024-04-15T15:25:02.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.472+0000 7fe8637fe640 10 client.33615.objecter ms_handle_connect 0x7fe84c06ee60 2024-04-15T15:25:02.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(996..996 src has 660..996) ==== 5226+0+0 (unknown 2702740487 0 0) 0x7fe864053580 con 0x7fe86c09d0f0 2024-04-15T15:25:02.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 10 client.33615.objecter ms_dispatch 0x7fe86c000b90 osd_map(996..996 src has 660..996) 2024-04-15T15:25:02.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 3 client.33615.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 3 client.33615.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 10 client.33615.objecter checking command 1 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 20 client.33615.objecter _get_session s=0x7fe84c077190 osd=5 3 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 20 client.33615.objecter put_session s=0x7fe84c077190 osd=5 3 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 15 client.33615.objecter _session_command_op_remove -1 1 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 20 client.33615.objecter _get_session s=0x7fe84c077190 osd=5 3 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 20 client.33615.objecter get_session s=0x7fe84c077190 osd=5 3 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 15 client.33615.objecter _session_command_op_assign 5 1 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 20 client.33615.objecter put_session s=0x7fe84c077190 osd=5 4 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 10 client.33615.objecter _send_command 1 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 --> v1:172.21.15.164:6804/350713352 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe84c07b4b0 con 0x7fe84c077840 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 20 client.33615.objecter dump_active .. 0 homeless 2024-04-15T15:25:02.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_get_version_reply(handle=1 version=996) ==== 24+0+0 (unknown 1347525425 0 0) 0x7fe864051490 con 0x7fe86c09d0f0 2024-04-15T15:25:02.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.476+0000 7fe8637fe640 10 monclient: handle_get_version_reply finishing 1 version 996 2024-04-15T15:25:02.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.477+0000 7fe863fff640 10 monclient: get_auth_request con 0x7fe84c077840 auth_method 0 2024-04-15T15:25:02.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.479+0000 7fe8637fe640 10 client.33615.objecter ms_handle_connect 0x7fe84c077840 2024-04-15T15:25:02.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.503+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== osd.5 v1:172.21.15.164:6804/350713352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fe84c07b4b0 con 0x7fe84c077840 2024-04-15T15:25:02.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.503+0000 7fe8637fe640 10 client.33615.objecter ms_dispatch 0x7fe86c000b90 command_reply(tid 1: 0 ) 2024-04-15T15:25:02.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.503+0000 7fe8637fe640 10 client.33615.objecter _finish_command 1 = system:0 2024-04-15T15:25:02.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.503+0000 7fe8637fe640 20 client.33615.objecter put_session s=0x7fe84c077190 osd=5 4 2024-04-15T15:25:02.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.503+0000 7fe8637fe640 15 client.33615.objecter _session_command_op_remove 5 1 2024-04-15T15:25:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 10 client.33615.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-04-15T15:25:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 15 client.33615.objecter _session_command_op_assign -1 2 2024-04-15T15:25:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 20 client.33615.objecter _get_session s=0x7fe84c077190 osd=5 3 2024-04-15T15:25:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 20 client.33615.objecter put_session s=0x7fe84c077190 osd=5 3 2024-04-15T15:25:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 20 client.33615.objecter _get_session s=0x7fe84c077190 osd=5 3 2024-04-15T15:25:02.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 15 client.33615.objecter _session_command_op_remove -1 2 2024-04-15T15:25:02.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 20 client.33615.objecter get_session s=0x7fe84c077190 osd=5 3 2024-04-15T15:25:02.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 15 client.33615.objecter _session_command_op_assign 5 2 2024-04-15T15:25:02.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 20 client.33615.objecter put_session s=0x7fe84c077190 osd=5 4 2024-04-15T15:25:02.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 10 client.33615.objecter _send_command 2 2024-04-15T15:25:02.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.520+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 --> v1:172.21.15.164:6804/350713352 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe86c069030 con 0x7fe84c077840 2024-04-15T15:25:02.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe8637fe640 1 -- 172.21.15.38:0/3783040523 <== osd.5 v1:172.21.15.164:6804/350713352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe86c069030 con 0x7fe84c077840 2024-04-15T15:25:02.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe8637fe640 10 client.33615.objecter ms_dispatch 0x7fe86c000b90 command_reply(tid 2: 0 ) 2024-04-15T15:25:02.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe8637fe640 10 client.33615.objecter _finish_command 2 = system:0 2024-04-15T15:25:02.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe8637fe640 20 client.33615.objecter put_session s=0x7fe84c077190 osd=5 4 2024-04-15T15:25:02.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe8637fe640 15 client.33615.objecter _session_command_op_remove 5 2 2024-04-15T15:25:02.538 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-15T15:25:02.538 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:25:02.538 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-15T15:25:02.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 10 librados: watch_flush enter 2024-04-15T15:25:02.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 10 librados: watch_flush exit 2024-04-15T15:25:02.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 10 client.33615.objecter close_session for osd.5 2024-04-15T15:25:02.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 >> v1:172.21.15.164:6804/350713352 conn(0x7fe84c077840 legacy=0x7fe84c079ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 20 client.33615.objecter put_session s=0x7fe84c077190 osd=5 1 2024-04-15T15:25:02.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 20 client.33615.objecter shutdown clearing up homeless session... 2024-04-15T15:25:02.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 10 client.33615.objecter successfully canceled tick 2024-04-15T15:25:02.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 >> v1:172.21.15.38:6800/1608957829 conn(0x7fe84c06ee60 legacy=0x7fe84c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 10 monclient: shutdown 2024-04-15T15:25:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 >> v1:172.21.15.38:6789/0 conn(0x7fe86c09d0f0 legacy=0x7fe86c1e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe86b7fe640 1 -- 172.21.15.38:0/3783040523 reap_dead start 2024-04-15T15:25:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 shutdown_connections 2024-04-15T15:25:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 >> 172.21.15.38:0/3783040523 conn(0x7fe86c06cc50 msgr2=0x7fe86c13d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 shutdown_connections 2024-04-15T15:25:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 1 -- 172.21.15.38:0/3783040523 wait complete. 2024-04-15T15:25:02.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.536+0000 7fe871332640 1 librados: shutdown 2024-04-15T15:25:02.549 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-15T15:25:02.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.657+0000 7fe346733640 10 monclient: get_monmap_and_config 2024-04-15T15:25:02.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.657+0000 7fe346733640 10 monclient: build_initial_monmap 2024-04-15T15:25:02.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.657+0000 7fe346733640 10 monclient: monmap: 2024-04-15T15:25:02.660 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:02.658414+0000 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:02.658414+0000 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.659+0000 7fe346733640 1 Processor -- start 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.659+0000 7fe346733640 1 -- start start 2024-04-15T15:25:02.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.659+0000 7fe346733640 10 monclient: init 2024-04-15T15:25:02.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T15:25:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 10 monclient(hunting): picked mon.noname-a con 0x7fe3400aaf60 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 10 monclient(hunting): picked mon.noname-b con 0x7fe340143410 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 10 monclient(hunting): picked mon.noname-c con 0x7fe3401402d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe340140720 con 0x7fe3400aaf60 2024-04-15T15:25:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3400acf00 con 0x7fe3401402d0 2024-04-15T15:25:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3400ad1e0 con 0x7fe340143410 2024-04-15T15:25:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.660+0000 7fe346733640 10 monclient(hunting): authenticate will time out at 2962.930700s 2024-04-15T15:25:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.663+0000 7fe344cd0640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fe3401402d0 0x7fe34014b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:56490/0 (socket says 172.21.15.38:56490) 2024-04-15T15:25:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.663+0000 7fe344cd0640 1 -- 172.21.15.38:0/1331186803 learned_addr learned my addr 172.21.15.38:0/1331186803 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:02.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.756+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100441456 0 0) 0x7fe340140720 con 0x7fe3400aaf60 2024-04-15T15:25:02.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.756+0000 7fe33f7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.756+0000 7fe33f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.756+0000 7fe33f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.756+0000 7fe33f7fe640 10 monclient(hunting): my global_id is 33618 2024-04-15T15:25:02.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.756+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe32c004630 con 0x7fe3400aaf60 2024-04-15T15:25:02.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.769+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369858688 0 0) 0x7fe3400ad1e0 con 0x7fe340143410 2024-04-15T15:25:02.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.769+0000 7fe33f7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.769+0000 7fe33f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.769+0000 7fe33f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.769+0000 7fe33f7fe640 10 monclient(hunting): my global_id is 81086 2024-04-15T15:25:02.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.769+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe340140720 con 0x7fe340143410 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2258649557 0 0) 0x7fe32c004630 con 0x7fe3400aaf60 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 >> v1:172.21.15.38:6790/0 conn(0x7fe340143410 legacy=0x7fe34013fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 >> v1:172.21.15.164:6789/0 conn(0x7fe3401402d0 legacy=0x7fe34014b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 10 monclient: _finish_hunting 0 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 1 monclient: found mon.noname-a 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3400ad4c0 con 0x7fe3400aaf60 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 10 monclient: _finish_auth 0 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 10 monclient: _check_auth_tickets 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:02.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe330001610 con 0x7fe3400aaf60 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe346733640 5 monclient: authenticate success, global_id 33618 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe33f7fe640 10 monclient: dump: 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:02.774 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:02.775 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.771+0000 7fe346733640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:02.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.778+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe330001870 con 0x7fe3400aaf60 2024-04-15T15:25:02.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.778+0000 7fe33f7fe640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:02.779 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.778+0000 7fe33f7fe640 1 -- 172.21.15.38:0/1331186803 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe330001bc0 con 0x7fe3400aaf60 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.778+0000 7fe33f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.778+0000 7fe33f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.778+0000 7fe33f7fe640 10 monclient: dump: 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.778+0000 7fe346733640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:02.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.778+0000 7fe346733640 4 set_mon_vals no callback set 2024-04-15T15:25:02.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.779+0000 7fe346733640 10 monclient: shutdown 2024-04-15T15:25:02.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.779+0000 7fe346733640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:02.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.779+0000 7fe346733640 1 -- 172.21.15.38:0/1331186803 >> v1:172.21.15.38:6789/0 conn(0x7fe3400aaf60 legacy=0x7fe340142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.779+0000 7fe346733640 1 -- 172.21.15.38:0/1331186803 shutdown_connections 2024-04-15T15:25:02.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.779+0000 7fe346733640 1 -- 172.21.15.38:0/1331186803 >> 172.21.15.38:0/1331186803 conn(0x7fe340068140 msgr2=0x7fe3400b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:02.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.779+0000 7fe346733640 1 -- 172.21.15.38:0/1331186803 shutdown_connections 2024-04-15T15:25:02.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.779+0000 7fe346733640 1 -- 172.21.15.38:0/1331186803 wait complete. 2024-04-15T15:25:02.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.780+0000 7fe346733640 10 monclient: build_initial_monmap 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.780+0000 7fe346733640 10 monclient: monmap: 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.780+0000 7fe346733640 1 librados: starting msgr at 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.780+0000 7fe346733640 1 librados: starting objecter 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 1 Processor -- start 2024-04-15T15:25:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 1 -- start start 2024-04-15T15:25:02.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 1 librados: setting wanted keys 2024-04-15T15:25:02.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 1 librados: calling monclient init 2024-04-15T15:25:02.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 10 monclient: init 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 10 monclient(hunting): picked mon.noname-b con 0x7fe3400aaf60 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 10 monclient(hunting): picked mon.noname-c con 0x7fe3401402d0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 10 monclient(hunting): picked mon.noname-a con 0x7fe340143410 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.781+0000 7fe346733640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34006f280 con 0x7fe340143410 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.782+0000 7fe346733640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3401d83c0 con 0x7fe3400aaf60 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.782+0000 7fe346733640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3401d7790 con 0x7fe3401402d0 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.782+0000 7fe346733640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.782+0000 7fe346733640 10 monclient(hunting): authenticate will time out at 2963.052434s 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.782+0000 7fe33ffff640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fe3400aaf60 0x7fe34006eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:56494/0 (socket says 172.21.15.38:56494) 2024-04-15T15:25:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.782+0000 7fe33ffff640 1 -- 172.21.15.38:0/820646542 learned_addr learned my addr 172.21.15.38:0/820646542 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:02.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.783+0000 7fe33d7fa640 10 client.?.objecter ms_handle_connect 0x7fe3400aaf60 2024-04-15T15:25:02.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.783+0000 7fe33d7fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:02.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.785+0000 7fe33d7fa640 10 client.?.objecter ms_handle_connect 0x7fe3401402d0 2024-04-15T15:25:02.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.785+0000 7fe33d7fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:02.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.788+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932762432 0 0) 0x7fe3401d83c0 con 0x7fe3400aaf60 2024-04-15T15:25:02.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.788+0000 7fe33d7fa640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.788+0000 7fe33d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.788+0000 7fe33d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.788+0000 7fe33d7fa640 10 monclient(hunting): my global_id is 32341 2024-04-15T15:25:02.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.788+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe320004eb0 con 0x7fe3400aaf60 2024-04-15T15:25:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.790+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303487005 0 0) 0x7fe3401d7790 con 0x7fe3401402d0 2024-04-15T15:25:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.790+0000 7fe33d7fa640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.790+0000 7fe33d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.790+0000 7fe33d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.790+0000 7fe33d7fa640 10 monclient(hunting): my global_id is 81089 2024-04-15T15:25:02.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.790+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3401d83c0 con 0x7fe3401402d0 2024-04-15T15:25:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.790+0000 7fe33d7fa640 10 client.?.objecter ms_handle_connect 0x7fe340143410 2024-04-15T15:25:02.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.790+0000 7fe33d7fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:02.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.795+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986656671 0 0) 0x7fe34006f280 con 0x7fe340143410 2024-04-15T15:25:02.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.795+0000 7fe33d7fa640 10 monclient(hunting): _negotiate 2024-04-15T15:25:02.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.795+0000 7fe33d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:02.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.795+0000 7fe33d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:02.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.795+0000 7fe33d7fa640 10 monclient(hunting): my global_id is 33621 2024-04-15T15:25:02.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.795+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3401d7790 con 0x7fe340143410 2024-04-15T15:25:02.797 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.796+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1972984290 0 0) 0x7fe320004eb0 con 0x7fe3400aaf60 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.796+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe34006f280 con 0x7fe3400aaf60 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.796+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe330001c80 con 0x7fe3400aaf60 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.796+0000 7fe33d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.796+0000 7fe33d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.796+0000 7fe33d7fa640 10 monclient(hunting): dump: 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:02.798 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:02.799 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:02.799 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.799 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.796+0000 7fe33d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:02.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 381639906 0 0) 0x7fe34006f280 con 0x7fe3400aaf60 2024-04-15T15:25:02.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 >> v1:172.21.15.38:6790/0 conn(0x7fe3401402d0 legacy=0x7fe3401d7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 >> v1:172.21.15.38:6789/0 conn(0x7fe340143410 legacy=0x7fe3401deae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:02.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 10 monclient: _finish_hunting 0 2024-04-15T15:25:02.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 1 monclient: found mon.b 2024-04-15T15:25:02.802 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34013d820 con 0x7fe3400aaf60 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 10 monclient: _finish_auth 0 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 10 monclient: _check_auth_tickets 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe33d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe346733640 5 monclient: authenticate success, global_id 32341 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe346733640 10 monclient: _renew_subs 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe346733640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe34006f9f0 con 0x7fe3400aaf60 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe346733640 10 client.32341.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe346733640 10 monclient: _renew_subs 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe346733640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe34013afd0 con 0x7fe3400aaf60 2024-04-15T15:25:02.803 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.800+0000 7fe346733640 1 librados: init done 2024-04-15T15:25:02.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.801+0000 7fe346733640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:02.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.801+0000 7fe346733640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:02.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.801+0000 7fe346733640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:02.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.801+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe340077050 con 0x7fe3400aaf60 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.816+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe330001790 con 0x7fe3400aaf60 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.816+0000 7fe33d7fa640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.816+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fe330003b50 con 0x7fe3400aaf60 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.816+0000 7fe33d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.816+0000 7fe33d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.816+0000 7fe33d7fa640 10 monclient: dump: 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:02.818 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:02.819 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:02.819 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:02.819 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:02.819 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:02.819 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:02.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.816+0000 7fe33effd640 4 set_mon_vals no callback set 2024-04-15T15:25:02.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.817+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fe330003d30 con 0x7fe3400aaf60 2024-04-15T15:25:02.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.817+0000 7fe337fff640 10 monclient: get_auth_request con 0x7fe32006ef00 auth_method 0 2024-04-15T15:25:02.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.818+0000 7fe33d7fa640 10 client.32341.objecter ms_handle_connect 0x7fe32006ef00 2024-04-15T15:25:02.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.818+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 660..996) ==== 5226+0+0 (unknown 2702740487 0 0) 0x7fe3300533f0 con 0x7fe3400aaf60 2024-04-15T15:25:02.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.818+0000 7fe33d7fa640 10 client.32341.objecter ms_dispatch 0x7fe340000b90 osd_map(996..996 src has 660..996) 2024-04-15T15:25:02.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.818+0000 7fe33d7fa640 3 client.32341.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:02.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.818+0000 7fe33d7fa640 3 client.32341.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:02.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:02.818+0000 7fe33d7fa640 20 client.32341.objecter dump_active .. 0 homeless 2024-04-15T15:25:03.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.054+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fe330085e20 con 0x7fe3400aaf60 2024-04-15T15:25:03.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.054+0000 7fe33d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:03.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.054+0000 7fe33d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:25:03.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.242+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe3401d7540 con 0x7fe32006ef00 2024-04-15T15:25:03.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.242+0000 7fe33d7fa640 1 -- 172.21.15.38:0/820646542 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fe3401d7540 con 0x7fe32006ef00 2024-04-15T15:25:03.243 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 5 to deep-scrub 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 10 librados: watch_flush enter 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 10 librados: watch_flush exit 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 20 client.32341.objecter shutdown clearing up homeless session... 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 10 client.32341.objecter successfully canceled tick 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 >> v1:172.21.15.38:6800/1608957829 conn(0x7fe32006ef00 legacy=0x7fe3200713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 10 monclient: shutdown 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 >> v1:172.21.15.164:6789/0 conn(0x7fe3400aaf60 legacy=0x7fe34006eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 shutdown_connections 2024-04-15T15:25:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 >> 172.21.15.38:0/820646542 conn(0x7fe340068140 msgr2=0x7fe34013f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:03.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 shutdown_connections 2024-04-15T15:25:03.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 1 -- 172.21.15.38:0/820646542 wait complete. 2024-04-15T15:25:03.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.244+0000 7fe346733640 1 librados: shutdown 2024-04-15T15:25:03.257 INFO:tasks.ceph:Scrubbing osd.6 2024-04-15T15:25:03.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.363+0000 7f6caf19d640 10 monclient: get_monmap_and_config 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.363+0000 7f6caf19d640 10 monclient: build_initial_monmap 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.363+0000 7f6caf19d640 10 monclient: monmap: 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:03.364513+0000 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:03.364513+0000 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:03.365 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:03.366 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:03.366 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.364+0000 7f6caf19d640 1 Processor -- start 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.364+0000 7f6caf19d640 1 -- start start 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.364+0000 7f6caf19d640 10 monclient: init 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 10 monclient(hunting): picked mon.noname-c con 0x7f6ca80aca00 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 10 monclient(hunting): picked mon.noname-b con 0x7f6ca80acde0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 10 monclient(hunting): picked mon.noname-a con 0x7f6ca813e700 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca80ad780 con 0x7f6ca813e700 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca80735a0 con 0x7f6ca80aca00 2024-04-15T15:25:03.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca80addb0 con 0x7f6ca80acde0 2024-04-15T15:25:03.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:03.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6caf19d640 10 monclient(hunting): authenticate will time out at 2963.635538s 2024-04-15T15:25:03.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6cad73a640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ca813e700 0x7f6ca8141800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44378/0 (socket says 172.21.15.38:44378) 2024-04-15T15:25:03.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6c9ffff640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f6ca80acde0 0x7f6ca81410f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:49924/0 (socket says 172.21.15.38:49924) 2024-04-15T15:25:03.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.365+0000 7f6cad73a640 1 -- 172.21.15.38:0/1595094787 learned_addr learned my addr 172.21.15.38:0/1595094787 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:03.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203974000 0 0) 0x7f6ca80735a0 con 0x7f6ca80aca00 2024-04-15T15:25:03.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): my global_id is 32344 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c90003520 con 0x7f6ca80aca00 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508664424 0 0) 0x7f6ca80ad780 con 0x7f6ca813e700 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): my global_id is 33624 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca80735a0 con 0x7f6ca813e700 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474592020 0 0) 0x7f6ca80addb0 con 0x7f6ca80acde0 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 10 monclient(hunting): my global_id is 81092 2024-04-15T15:25:03.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.368+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca80ad780 con 0x7f6ca80acde0 2024-04-15T15:25:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 749758415 0 0) 0x7f6ca80735a0 con 0x7f6ca813e700 2024-04-15T15:25:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 >> v1:172.21.15.38:6790/0 conn(0x7f6ca80acde0 legacy=0x7f6ca81410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 >> v1:172.21.15.164:6789/0 conn(0x7f6ca80aca00 legacy=0x7f6ca813dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 10 monclient: _finish_hunting 0 2024-04-15T15:25:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 1 monclient: found mon.noname-a 2024-04-15T15:25:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:03.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca81507b0 con 0x7f6ca813e700 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 10 monclient: _finish_auth 0 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 10 monclient: _check_auth_tickets 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6ca0001970 con 0x7f6ca813e700 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6caf19d640 5 monclient: authenticate success, global_id 33624 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6caf19d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6c9f7fe640 10 monclient: dump: 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.373 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.374 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.374 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.374 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.374 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.374 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.370+0000 7f6caf19d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:03.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ca0001bd0 con 0x7f6ca813e700 2024-04-15T15:25:03.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6c9f7fe640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:03.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6c9f7fe640 1 -- 172.21.15.38:0/1595094787 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6ca0001f60 con 0x7f6ca813e700 2024-04-15T15:25:03.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6c9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:03.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6c9f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:03.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6c9f7fe640 10 monclient: dump: 2024-04-15T15:25:03.375 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.375 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6caf19d640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6caf19d640 4 set_mon_vals no callback set 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6caf19d640 10 monclient: shutdown 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6caf19d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6caf19d640 1 -- 172.21.15.38:0/1595094787 >> v1:172.21.15.38:6789/0 conn(0x7f6ca813e700 legacy=0x7f6ca8141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6caf19d640 1 -- 172.21.15.38:0/1595094787 shutdown_connections 2024-04-15T15:25:03.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.373+0000 7f6caf19d640 1 -- 172.21.15.38:0/1595094787 >> 172.21.15.38:0/1595094787 conn(0x7f6ca8068070 msgr2=0x7f6ca80b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:03.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.374+0000 7f6caf19d640 1 -- 172.21.15.38:0/1595094787 shutdown_connections 2024-04-15T15:25:03.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.374+0000 7f6caf19d640 1 -- 172.21.15.38:0/1595094787 wait complete. 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.374+0000 7f6caf19d640 10 monclient: build_initial_monmap 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.374+0000 7f6caf19d640 10 monclient: monmap: 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:03.379 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.374+0000 7f6caf19d640 1 librados: starting msgr at 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.374+0000 7f6caf19d640 1 librados: starting objecter 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 1 Processor -- start 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 1 -- start start 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 1 librados: setting wanted keys 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 1 librados: calling monclient init 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 10 monclient: init 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 10 monclient(hunting): picked mon.noname-a con 0x7f6ca80aca00 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 10 monclient(hunting): picked mon.noname-b con 0x7f6ca80acde0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 10 monclient(hunting): picked mon.noname-c con 0x7f6ca813e700 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca8145030 con 0x7f6ca80aca00 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca80ac3c0 con 0x7f6ca80acde0 2024-04-15T15:25:03.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca81db8d0 con 0x7f6ca813e700 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.375+0000 7f6caf19d640 10 monclient(hunting): authenticate will time out at 2963.646280s 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.376+0000 7f6cacf39640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6ca80aca00 0x7f6ca8142230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44388/0 (socket says 172.21.15.38:44388) 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.376+0000 7f6cacf39640 1 -- 172.21.15.38:0/4094606389 learned_addr learned my addr 172.21.15.38:0/4094606389 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.376+0000 7f6c9d7fa640 10 client.?.objecter ms_handle_connect 0x7f6ca80aca00 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.376+0000 7f6c9d7fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.376+0000 7f6c9d7fa640 10 client.?.objecter ms_handle_connect 0x7f6ca813e700 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.376+0000 7f6c9d7fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.376+0000 7f6c9d7fa640 10 client.?.objecter ms_handle_connect 0x7f6ca80acde0 2024-04-15T15:25:03.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.376+0000 7f6c9d7fa640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:03.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675768205 0 0) 0x7f6ca80ac3c0 con 0x7f6ca80acde0 2024-04-15T15:25:03.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): my global_id is 32347 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c94004eb0 con 0x7f6ca80acde0 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732437645 0 0) 0x7f6ca8145030 con 0x7f6ca80aca00 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): my global_id is 33627 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca80ac3c0 con 0x7f6ca80aca00 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780343027 0 0) 0x7f6ca81db8d0 con 0x7f6ca813e700 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 10 monclient(hunting): my global_id is 81095 2024-04-15T15:25:03.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.378+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca8145030 con 0x7f6ca813e700 2024-04-15T15:25:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.382+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 301659159 0 0) 0x7f6c94004eb0 con 0x7f6ca80acde0 2024-04-15T15:25:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.383+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ca81db8d0 con 0x7f6ca80acde0 2024-04-15T15:25:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.383+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6c98001830 con 0x7f6ca80acde0 2024-04-15T15:25:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.383+0000 7f6c9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.383+0000 7f6c9d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.383+0000 7f6c9d7fa640 10 monclient(hunting): dump: 2024-04-15T15:25:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.384 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.385 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.385 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.385 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.385 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.385 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.385 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.385 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.383+0000 7f6c9d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:03.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3887897178 0 0) 0x7f6ca80ac3c0 con 0x7f6ca80aca00 2024-04-15T15:25:03.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c94004eb0 con 0x7f6ca80aca00 2024-04-15T15:25:03.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6ca4001950 con 0x7f6ca80aca00 2024-04-15T15:25:03.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:03.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:03.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 10 monclient(hunting): dump: 2024-04-15T15:25:03.386 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.386 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.386 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3380947433 0 0) 0x7f6ca8145030 con 0x7f6ca813e700 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ca80ac3c0 con 0x7f6ca813e700 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6ca0001870 con 0x7f6ca813e700 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.384+0000 7f6c9d7fa640 10 monclient(hunting): dump: 2024-04-15T15:25:03.387 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.388 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.388 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.388 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.388 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.388 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.388 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.388 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.388 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.388 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3340505386 0 0) 0x7f6ca81db8d0 con 0x7f6ca80acde0 2024-04-15T15:25:03.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 >> v1:172.21.15.38:6790/0 conn(0x7f6ca813e700 legacy=0x7f6ca81e3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 >> v1:172.21.15.38:6789/0 conn(0x7f6ca80aca00 legacy=0x7f6ca8142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 10 monclient: _finish_hunting 0 2024-04-15T15:25:03.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 1 monclient: found mon.b 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca8143400 con 0x7f6ca80acde0 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 10 monclient: _finish_auth 0 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 10 monclient: _check_auth_tickets 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6c9d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6caf19d640 5 monclient: authenticate success, global_id 32347 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6caf19d640 10 monclient: _renew_subs 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6caf19d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca8142940 con 0x7f6ca80acde0 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6caf19d640 10 client.32347.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6caf19d640 10 monclient: _renew_subs 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6caf19d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:03.390 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ca813d440 con 0x7f6ca80acde0 2024-04-15T15:25:03.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.386+0000 7f6caf19d640 1 librados: init done 2024-04-15T15:25:03.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.387+0000 7f6caf19d640 10 client.32347.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:03.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.387+0000 7f6caf19d640 15 client.32347.objecter _session_command_op_assign -1 1 2024-04-15T15:25:03.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.387+0000 7f6caf19d640 20 client.32347.objecter _get_session osd=-1 returning homeless 2024-04-15T15:25:03.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.387+0000 7f6caf19d640 10 client.32347.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:03.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.387+0000 7f6caf19d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:03.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.387+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6ca8077050 con 0x7f6ca80acde0 2024-04-15T15:25:03.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.402+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ca8077050 con 0x7f6ca80acde0 2024-04-15T15:25:03.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.402+0000 7f6c9d7fa640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:03.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.402+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f6c98004980 con 0x7f6ca80acde0 2024-04-15T15:25:03.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.402+0000 7f6c9d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:03.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.402+0000 7f6c9d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.402+0000 7f6c9d7fa640 10 monclient: dump: 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.402+0000 7f6c9e7fc640 4 set_mon_vals no callback set 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.403+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f6c9801aeb0 con 0x7f6ca80acde0 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.403+0000 7f6cacf39640 10 monclient: get_auth_request con 0x7f6c9406eed0 auth_method 0 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.403+0000 7f6c9d7fa640 10 client.32347.objecter ms_handle_connect 0x7f6c9406eed0 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 660..996) ==== 5226+0+0 (unknown 2702740487 0 0) 0x7f6c980530a0 con 0x7f6ca80acde0 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 10 client.32347.objecter ms_dispatch 0x7f6ca8000b90 osd_map(996..996 src has 660..996) 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 3 client.32347.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 3 client.32347.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 10 client.32347.objecter checking command 1 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 20 client.32347.objecter _get_session s=0x7f6c94077170 osd=6 3 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 20 client.32347.objecter put_session s=0x7f6c94077170 osd=6 3 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 15 client.32347.objecter _session_command_op_remove -1 1 2024-04-15T15:25:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 20 client.32347.objecter _get_session s=0x7f6c94077170 osd=6 3 2024-04-15T15:25:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 20 client.32347.objecter get_session s=0x7f6c94077170 osd=6 3 2024-04-15T15:25:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 15 client.32347.objecter _session_command_op_assign 6 1 2024-04-15T15:25:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 20 client.32347.objecter put_session s=0x7f6c94077170 osd=6 4 2024-04-15T15:25:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 10 client.32347.objecter _send_command 1 2024-04-15T15:25:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.164:6808/3078148286 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c9407b530 con 0x7f6c94077820 2024-04-15T15:25:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6c9d7fa640 20 client.32347.objecter dump_active .. 0 homeless 2024-04-15T15:25:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.404+0000 7f6cad73a640 10 monclient: get_auth_request con 0x7f6c94077820 auth_method 0 2024-04-15T15:25:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.406+0000 7f6c9d7fa640 10 client.32347.objecter ms_handle_connect 0x7f6c94077820 2024-04-15T15:25:03.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.407+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=996) ==== 24+0+0 (unknown 1347525425 0 0) 0x7f6c98050fb0 con 0x7f6ca80acde0 2024-04-15T15:25:03.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.407+0000 7f6c9d7fa640 10 monclient: handle_get_version_reply finishing 1 version 996 2024-04-15T15:25:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.429+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== osd.6 v1:172.21.15.164:6808/3078148286 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f6c9407b530 con 0x7f6c94077820 2024-04-15T15:25:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.429+0000 7f6c9d7fa640 10 client.32347.objecter ms_dispatch 0x7f6ca8000b90 command_reply(tid 1: 0 ) 2024-04-15T15:25:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.429+0000 7f6c9d7fa640 10 client.32347.objecter _finish_command 1 = system:0 2024-04-15T15:25:03.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.429+0000 7f6c9d7fa640 20 client.32347.objecter put_session s=0x7f6c94077170 osd=6 4 2024-04-15T15:25:03.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.429+0000 7f6c9d7fa640 15 client.32347.objecter _session_command_op_remove 6 1 2024-04-15T15:25:03.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 10 client.32347.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 15 client.32347.objecter _session_command_op_assign -1 2 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 20 client.32347.objecter _get_session s=0x7f6c94077170 osd=6 3 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 20 client.32347.objecter put_session s=0x7f6c94077170 osd=6 3 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 20 client.32347.objecter _get_session s=0x7f6c94077170 osd=6 3 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 15 client.32347.objecter _session_command_op_remove -1 2 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 20 client.32347.objecter get_session s=0x7f6c94077170 osd=6 3 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 15 client.32347.objecter _session_command_op_assign 6 2 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 20 client.32347.objecter put_session s=0x7f6c94077170 osd=6 4 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 10 client.32347.objecter _send_command 2 2024-04-15T15:25:03.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.442+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 --> v1:172.21.15.164:6808/3078148286 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ca8145200 con 0x7f6c94077820 2024-04-15T15:25:03.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6c9d7fa640 1 -- 172.21.15.38:0/4094606389 <== osd.6 v1:172.21.15.164:6808/3078148286 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f6ca8145200 con 0x7f6c94077820 2024-04-15T15:25:03.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6c9d7fa640 10 client.32347.objecter ms_dispatch 0x7f6ca8000b90 command_reply(tid 2: 0 ) 2024-04-15T15:25:03.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6c9d7fa640 10 client.32347.objecter _finish_command 2 = system:0 2024-04-15T15:25:03.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6c9d7fa640 20 client.32347.objecter put_session s=0x7f6c94077170 osd=6 4 2024-04-15T15:25:03.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6c9d7fa640 15 client.32347.objecter _session_command_op_remove 6 2 2024-04-15T15:25:03.457 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-15T15:25:03.457 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:25:03.457 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 10 librados: watch_flush enter 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 10 librados: watch_flush exit 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 10 client.32347.objecter close_session for osd.6 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 >> v1:172.21.15.164:6808/3078148286 conn(0x7f6c94077820 legacy=0x7f6c94079cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 20 client.32347.objecter put_session s=0x7f6c94077170 osd=6 1 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 20 client.32347.objecter shutdown clearing up homeless session... 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 10 client.32347.objecter successfully canceled tick 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 >> v1:172.21.15.38:6800/1608957829 conn(0x7f6c9406eed0 legacy=0x7f6c94071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 10 monclient: shutdown 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 >> v1:172.21.15.164:6789/0 conn(0x7f6ca80acde0 legacy=0x7f6ca81dbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.455+0000 7f6cad73a640 1 -- 172.21.15.38:0/4094606389 reap_dead start 2024-04-15T15:25:03.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.456+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 shutdown_connections 2024-04-15T15:25:03.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.456+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 >> 172.21.15.38:0/4094606389 conn(0x7f6ca8068070 msgr2=0x7f6ca806aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:03.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.456+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 shutdown_connections 2024-04-15T15:25:03.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.456+0000 7f6caf19d640 1 -- 172.21.15.38:0/4094606389 wait complete. 2024-04-15T15:25:03.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.456+0000 7f6caf19d640 1 librados: shutdown 2024-04-15T15:25:03.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-15T15:25:03.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.574+0000 7fb17d088640 10 monclient: get_monmap_and_config 2024-04-15T15:25:03.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.574+0000 7fb17d088640 10 monclient: build_initial_monmap 2024-04-15T15:25:03.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.574+0000 7fb17d088640 10 monclient: monmap: 2024-04-15T15:25:03.576 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:03.576 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.576 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:03.575657+0000 2024-04-15T15:25:03.576 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:03.575657+0000 2024-04-15T15:25:03.576 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:03.576 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.577 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:03.577 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:03.577 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:03.577 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.575+0000 7fb17d088640 1 Processor -- start 2024-04-15T15:25:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.575+0000 7fb17d088640 1 -- start start 2024-04-15T15:25:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.575+0000 7fb17d088640 10 monclient: init 2024-04-15T15:25:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T15:25:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 10 monclient(hunting): picked mon.noname-a con 0x7fb1780ae3e0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 10 monclient(hunting): picked mon.noname-b con 0x7fb1780aec20 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 10 monclient(hunting): picked mon.noname-c con 0x7fb17813eac0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1780b1370 con 0x7fb1780ae3e0 2024-04-15T15:25:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1780af670 con 0x7fb17813eac0 2024-04-15T15:25:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1780af840 con 0x7fb1780aec20 2024-04-15T15:25:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17d088640 10 monclient(hunting): authenticate will time out at 2963.846595s 2024-04-15T15:25:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb176d9d640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb1780ae3e0 0x7fb17813e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44392/0 (socket says 172.21.15.38:44392) 2024-04-15T15:25:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb176d9d640 1 -- 172.21.15.38:0/1780059700 learned_addr learned my addr 172.21.15.38:0/1780059700 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.576+0000 7fb17659c640 1 --1- 172.21.15.38:0/1780059700 >> v1:172.21.15.38:6790/0 conn(0x7fb1780aec20 0x7fb178144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:49940/0 (socket says 172.21.15.38:49940) 2024-04-15T15:25:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564264093 0 0) 0x7fb1780af670 con 0x7fb17813eac0 2024-04-15T15:25:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): my global_id is 32350 2024-04-15T15:25:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb164003520 con 0x7fb17813eac0 2024-04-15T15:25:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 643579719 0 0) 0x7fb1780b1370 con 0x7fb1780ae3e0 2024-04-15T15:25:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): my global_id is 33630 2024-04-15T15:25:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1780af670 con 0x7fb1780ae3e0 2024-04-15T15:25:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1721195834 0 0) 0x7fb1780af840 con 0x7fb1780aec20 2024-04-15T15:25:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 10 monclient(hunting): my global_id is 81098 2024-04-15T15:25:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.579+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1780b1370 con 0x7fb1780aec20 2024-04-15T15:25:03.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2711374863 0 0) 0x7fb164003520 con 0x7fb17813eac0 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 >> v1:172.21.15.38:6790/0 conn(0x7fb1780aec20 legacy=0x7fb178144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 >> v1:172.21.15.38:6789/0 conn(0x7fb1780ae3e0 legacy=0x7fb17813e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 10 monclient: _finish_hunting 0 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 1 monclient: found mon.noname-c 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1780afa10 con 0x7fb17813eac0 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 10 monclient: _finish_auth 0 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 10 monclient: _check_auth_tickets 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb170001610 con 0x7fb17813eac0 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:03.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb175d9b640 10 monclient: dump: 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb17d088640 5 monclient: authenticate success, global_id 32350 2024-04-15T15:25:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.582+0000 7fb17d088640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:03.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb170001870 con 0x7fb17813eac0 2024-04-15T15:25:03.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb175d9b640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:03.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb175d9b640 1 -- 172.21.15.38:0/1780059700 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb170001c40 con 0x7fb17813eac0 2024-04-15T15:25:03.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb175d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:03.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb175d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:03.587 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb175d9b640 10 monclient: dump: 2024-04-15T15:25:03.587 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.587 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.587 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb17d088640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb17d088640 4 set_mon_vals no callback set 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb17d088640 10 monclient: shutdown 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb17d088640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb17d088640 1 -- 172.21.15.38:0/1780059700 >> v1:172.21.15.164:6789/0 conn(0x7fb17813eac0 legacy=0x7fb178144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb17d088640 1 -- 172.21.15.38:0/1780059700 shutdown_connections 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb17d088640 1 -- 172.21.15.38:0/1780059700 >> 172.21.15.38:0/1780059700 conn(0x7fb178068140 msgr2=0x7fb1780b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:03.588 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb17d088640 1 -- 172.21.15.38:0/1780059700 shutdown_connections 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.584+0000 7fb17d088640 1 -- 172.21.15.38:0/1780059700 wait complete. 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.585+0000 7fb17d088640 10 monclient: build_initial_monmap 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.585+0000 7fb17d088640 10 monclient: monmap: 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 1 librados: starting msgr at 2024-04-15T15:25:03.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 1 librados: starting objecter 2024-04-15T15:25:03.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 1 Processor -- start 2024-04-15T15:25:03.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 1 -- start start 2024-04-15T15:25:03.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 1 librados: setting wanted keys 2024-04-15T15:25:03.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 1 librados: calling monclient init 2024-04-15T15:25:03.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 10 monclient: init 2024-04-15T15:25:03.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:03.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 10 monclient: _add_conns ranks=[2,0,1] 2024-04-15T15:25:03.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 10 monclient(hunting): picked mon.noname-c con 0x7fb1780ae3e0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:03.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 10 monclient(hunting): picked mon.noname-a con 0x7fb1780aec20 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 10 monclient(hunting): picked mon.noname-b con 0x7fb17813eac0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb178137130 con 0x7fb1780aec20 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1781dc700 con 0x7fb17813eac0 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17814d560 con 0x7fb1780ae3e0 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.586+0000 7fb17d088640 10 monclient(hunting): authenticate will time out at 2963.857363s 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.587+0000 7fb17759e640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fb17813eac0 0x7fb178134f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:56512/0 (socket says 172.21.15.38:56512) 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.587+0000 7fb17659c640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb1780aec20 0x7fb178130b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44400/0 (socket says 172.21.15.38:44400) 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.587+0000 7fb17759e640 1 -- 172.21.15.38:0/1885658623 learned_addr learned my addr 172.21.15.38:0/1885658623 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.587+0000 7fb16f7fe640 10 client.?.objecter ms_handle_connect 0x7fb17813eac0 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.587+0000 7fb16f7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.587+0000 7fb16f7fe640 10 client.?.objecter ms_handle_connect 0x7fb1780ae3e0 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.587+0000 7fb16f7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.587+0000 7fb16f7fe640 10 client.?.objecter ms_handle_connect 0x7fb1780aec20 2024-04-15T15:25:03.593 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.587+0000 7fb16f7fe640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.589+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544734498 0 0) 0x7fb1781dc700 con 0x7fb17813eac0 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.589+0000 7fb16f7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.589+0000 7fb16f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.589+0000 7fb16f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.589+0000 7fb16f7fe640 10 monclient(hunting): my global_id is 32353 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.589+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb158004eb0 con 0x7fb17813eac0 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 718549989 0 0) 0x7fb17814d560 con 0x7fb1780ae3e0 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 10 monclient(hunting): my global_id is 81101 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1781dc700 con 0x7fb1780ae3e0 2024-04-15T15:25:03.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352392441 0 0) 0x7fb178137130 con 0x7fb1780aec20 2024-04-15T15:25:03.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 10 monclient(hunting): _negotiate 2024-04-15T15:25:03.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:03.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:03.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 10 monclient(hunting): my global_id is 33633 2024-04-15T15:25:03.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.590+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb17814d560 con 0x7fb1780aec20 2024-04-15T15:25:03.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3549047599 0 0) 0x7fb158004eb0 con 0x7fb17813eac0 2024-04-15T15:25:03.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb178137130 con 0x7fb17813eac0 2024-04-15T15:25:03.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb170001bc0 con 0x7fb17813eac0 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 10 monclient(hunting): dump: 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:03.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2935939105 0 0) 0x7fb1781dc700 con 0x7fb1780ae3e0 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb158004eb0 con 0x7fb1780ae3e0 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb168001c30 con 0x7fb1780ae3e0 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.594+0000 7fb16f7fe640 10 monclient(hunting): dump: 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.598 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.595+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2090838264 0 0) 0x7fb17814d560 con 0x7fb1780aec20 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.595+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1781dc700 con 0x7fb1780aec20 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.595+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb1600017e0 con 0x7fb1780aec20 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.595+0000 7fb16f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.595+0000 7fb16f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.595+0000 7fb16f7fe640 10 monclient(hunting): dump: 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.599 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.600 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.600 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.600 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 996369153 0 0) 0x7fb1781dc700 con 0x7fb1780aec20 2024-04-15T15:25:03.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 >> v1:172.21.15.38:6790/0 conn(0x7fb1780ae3e0 legacy=0x7fb1781dbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 >> v1:172.21.15.164:6789/0 conn(0x7fb17813eac0 legacy=0x7fb178134f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:03.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 10 monclient: _finish_hunting 0 2024-04-15T15:25:03.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 1 monclient: found mon.a 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17814d730 con 0x7fb1780aec20 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 10 monclient: _finish_auth 0 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 10 monclient: _check_auth_tickets 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb16f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb17d088640 5 monclient: authenticate success, global_id 33633 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb17d088640 10 monclient: _renew_subs 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb17d088640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.597+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb1781dc1e0 con 0x7fb1780aec20 2024-04-15T15:25:03.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.598+0000 7fb17d088640 10 client.33633.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:03.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.598+0000 7fb17d088640 10 monclient: _renew_subs 2024-04-15T15:25:03.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.598+0000 7fb17d088640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:03.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.598+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb178131430 con 0x7fb1780aec20 2024-04-15T15:25:03.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.598+0000 7fb17d088640 1 librados: init done 2024-04-15T15:25:03.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.598+0000 7fb17d088640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:03.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.598+0000 7fb17d088640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:03.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.598+0000 7fb17d088640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:03.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.598+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb178077050 con 0x7fb1780aec20 2024-04-15T15:25:03.872 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.871+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1600047e0 con 0x7fb1780aec20 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.871+0000 7fb16f7fe640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.871+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb160004b30 con 0x7fb1780aec20 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.871+0000 7fb16f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.871+0000 7fb16f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.871+0000 7fb16f7fe640 10 monclient: dump: 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:03.874 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.871+0000 7fb17559a640 4 set_mon_vals no callback set 2024-04-15T15:25:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.872+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fb16001b060 con 0x7fb1780aec20 2024-04-15T15:25:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.872+0000 7fb176d9d640 10 monclient: get_auth_request con 0x7fb15806f040 auth_method 0 2024-04-15T15:25:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.872+0000 7fb16f7fe640 10 client.33633.objecter ms_handle_connect 0x7fb15806f040 2024-04-15T15:25:03.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.883+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(996..996 src has 660..996) ==== 5226+0+0 (unknown 2702740487 0 0) 0x7fb1600531f0 con 0x7fb1780aec20 2024-04-15T15:25:03.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.883+0000 7fb16f7fe640 10 client.33633.objecter ms_dispatch 0x7fb178000b90 osd_map(996..996 src has 660..996) 2024-04-15T15:25:03.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.883+0000 7fb16f7fe640 3 client.33633.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:03.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.883+0000 7fb16f7fe640 3 client.33633.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:03.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.883+0000 7fb16f7fe640 20 client.33633.objecter dump_active .. 0 homeless 2024-04-15T15:25:03.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.883+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fb1600555f0 con 0x7fb1780aec20 2024-04-15T15:25:03.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.883+0000 7fb16f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:03.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:03.883+0000 7fb16f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:25:04.078 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.077+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb178076020 con 0x7fb15806f040 2024-04-15T15:25:04.079 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.077+0000 7fb16f7fe640 1 -- 172.21.15.38:0/1885658623 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (unknown 778718403 0 0) 0x7fb178076020 con 0x7fb15806f040 2024-04-15T15:25:04.079 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 6 to deep-scrub 2024-04-15T15:25:04.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 10 librados: watch_flush enter 2024-04-15T15:25:04.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 10 librados: watch_flush exit 2024-04-15T15:25:04.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 20 client.33633.objecter shutdown clearing up homeless session... 2024-04-15T15:25:04.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 10 client.33633.objecter successfully canceled tick 2024-04-15T15:25:04.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 >> v1:172.21.15.38:6800/1608957829 conn(0x7fb15806f040 legacy=0x7fb158071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 10 monclient: shutdown 2024-04-15T15:25:04.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:04.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 >> v1:172.21.15.38:6789/0 conn(0x7fb1780aec20 legacy=0x7fb178130b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 shutdown_connections 2024-04-15T15:25:04.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 >> 172.21.15.38:0/1885658623 conn(0x7fb178068140 msgr2=0x7fb17806aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:04.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 shutdown_connections 2024-04-15T15:25:04.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.079+0000 7fb17d088640 1 -- 172.21.15.38:0/1885658623 wait complete. 2024-04-15T15:25:04.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.080+0000 7fb17d088640 1 librados: shutdown 2024-04-15T15:25:04.092 INFO:tasks.ceph:Scrubbing osd.7 2024-04-15T15:25:04.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-15T15:25:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.200+0000 7fe006559640 10 monclient: get_monmap_and_config 2024-04-15T15:25:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.200+0000 7fe006559640 10 monclient: build_initial_monmap 2024-04-15T15:25:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.200+0000 7fe006559640 10 monclient: monmap: 2024-04-15T15:25:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.202 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:04.200884+0000 2024-04-15T15:25:04.202 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:04.200884+0000 2024-04-15T15:25:04.202 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:04.202 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.202 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:04.202 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:04.202 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:04.202 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.200+0000 7fe006559640 1 Processor -- start 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.200+0000 7fe006559640 1 -- start start 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.200+0000 7fe006559640 10 monclient: init 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 10 monclient(hunting): picked mon.noname-c con 0x7fe0000b5a20 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 10 monclient(hunting): picked mon.noname-a con 0x7fe00013cd80 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 10 monclient(hunting): picked mon.noname-b con 0x7fe00013d200 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00013d610 con 0x7fe00013cd80 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0000ac1c0 con 0x7fe0000b5a20 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0000b5180 con 0x7fe00013d200 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.201+0000 7fe006559640 10 monclient(hunting): authenticate will time out at 2964.471956s 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.202+0000 7fe004af6640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fe00013d200 0x7fe00014ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:49968/0 (socket says 172.21.15.38:49968) 2024-04-15T15:25:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.202+0000 7fe004af6640 1 -- 172.21.15.38:0/3213318479 learned_addr learned my addr 172.21.15.38:0/3213318479 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:04.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.204+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008948031 0 0) 0x7fe0000ac1c0 con 0x7fe0000b5a20 2024-04-15T15:25:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.204+0000 7fdffeffd640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.204+0000 7fdffeffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.204+0000 7fdffeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.204+0000 7fdffeffd640 10 monclient(hunting): my global_id is 32356 2024-04-15T15:25:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.204+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfe8003520 con 0x7fe0000b5a20 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253830524 0 0) 0x7fe0000b5180 con 0x7fe00013d200 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 10 monclient(hunting): my global_id is 81104 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0000ac1c0 con 0x7fe00013d200 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357682417 0 0) 0x7fe00013d610 con 0x7fe00013cd80 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.207 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 10 monclient(hunting): my global_id is 33636 2024-04-15T15:25:04.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.205+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0000b5180 con 0x7fe00013cd80 2024-04-15T15:25:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 134100000 0 0) 0x7fdfe8003520 con 0x7fe0000b5a20 2024-04-15T15:25:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 >> v1:172.21.15.38:6790/0 conn(0x7fe00013d200 legacy=0x7fe00014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 >> v1:172.21.15.38:6789/0 conn(0x7fe00013cd80 legacy=0x7fe000143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 10 monclient: _finish_hunting 0 2024-04-15T15:25:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 1 monclient: found mon.noname-c 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe000143ca0 con 0x7fe0000b5a20 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 10 monclient: _finish_auth 0 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 10 monclient: _check_auth_tickets 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fdff0001610 con 0x7fe0000b5a20 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fdffeffd640 10 monclient: dump: 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.210 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.211 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fe006559640 5 monclient: authenticate success, global_id 32356 2024-04-15T15:25:04.211 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.207+0000 7fe006559640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.209+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdff0001870 con 0x7fe0000b5a20 2024-04-15T15:25:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.209+0000 7fdffeffd640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.209+0000 7fdffeffd640 1 -- 172.21.15.38:0/3213318479 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fdff0001c40 con 0x7fe0000b5a20 2024-04-15T15:25:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.209+0000 7fe006559640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.209+0000 7fe006559640 4 set_mon_vals no callback set 2024-04-15T15:25:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.209+0000 7fdffeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.209+0000 7fdffeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:04.213 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.209+0000 7fdffeffd640 10 monclient: dump: 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.210+0000 7fe006559640 10 monclient: shutdown 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.210+0000 7fe006559640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.210+0000 7fe006559640 1 -- 172.21.15.38:0/3213318479 >> v1:172.21.15.164:6789/0 conn(0x7fe0000b5a20 legacy=0x7fe0000aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.214 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.210+0000 7fe006559640 1 -- 172.21.15.38:0/3213318479 shutdown_connections 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.210+0000 7fe006559640 1 -- 172.21.15.38:0/3213318479 >> 172.21.15.38:0/3213318479 conn(0x7fe000067790 msgr2=0x7fe000067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.210+0000 7fe006559640 1 -- 172.21.15.38:0/3213318479 shutdown_connections 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.210+0000 7fe006559640 1 -- 172.21.15.38:0/3213318479 wait complete. 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.211+0000 7fe006559640 10 monclient: build_initial_monmap 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.211+0000 7fe006559640 10 monclient: monmap: 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:04.215 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.211+0000 7fe006559640 1 librados: starting msgr at 2024-04-15T15:25:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.211+0000 7fe006559640 1 librados: starting objecter 2024-04-15T15:25:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.211+0000 7fe006559640 1 Processor -- start 2024-04-15T15:25:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.211+0000 7fe006559640 1 -- start start 2024-04-15T15:25:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.211+0000 7fe006559640 1 librados: setting wanted keys 2024-04-15T15:25:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.211+0000 7fe006559640 1 librados: calling monclient init 2024-04-15T15:25:04.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.211+0000 7fe006559640 10 monclient: init 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 10 monclient(hunting): picked mon.noname-a con 0x7fe0000b5a20 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 10 monclient(hunting): picked mon.noname-c con 0x7fe00013cd80 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 10 monclient(hunting): picked mon.noname-b con 0x7fe00013d200 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0001d83a0 con 0x7fe0000b5a20 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0001d8570 con 0x7fe00013d200 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00013c680 con 0x7fe00013cd80 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:04.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.212+0000 7fe006559640 10 monclient(hunting): authenticate will time out at 2964.482870s 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.213+0000 7fdfff7fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fe00013cd80 0x7fe00013b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:49982/0 (socket says 172.21.15.38:49982) 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.213+0000 7fdfff7fe640 1 -- 172.21.15.38:0/2948995731 learned_addr learned my addr 172.21.15.38:0/2948995731 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.213+0000 7fdffcff9640 10 client.?.objecter ms_handle_connect 0x7fe00013cd80 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.213+0000 7fdffcff9640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.213+0000 7fdffcff9640 10 client.?.objecter ms_handle_connect 0x7fe0000b5a20 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.213+0000 7fdffcff9640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.213+0000 7fdffcff9640 10 client.?.objecter ms_handle_connect 0x7fe00013d200 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.213+0000 7fdffcff9640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944417641 0 0) 0x7fe0001d83a0 con 0x7fe0000b5a20 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): my global_id is 33639 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfec004eb0 con 0x7fe0000b5a20 2024-04-15T15:25:04.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416308990 0 0) 0x7fe0001d8570 con 0x7fe00013d200 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): my global_id is 32359 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0001d83a0 con 0x7fe00013d200 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394795849 0 0) 0x7fe00013c680 con 0x7fe00013cd80 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 10 monclient(hunting): my global_id is 81107 2024-04-15T15:25:04.220 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.215+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0001d8570 con 0x7fe00013cd80 2024-04-15T15:25:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3972045990 0 0) 0x7fe0001d83a0 con 0x7fe00013d200 2024-04-15T15:25:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe00013c680 con 0x7fe00013d200 2024-04-15T15:25:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fdff8001b50 con 0x7fe00013d200 2024-04-15T15:25:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:04.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 10 monclient(hunting): dump: 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 373916678 0 0) 0x7fe0001d8570 con 0x7fe00013cd80 2024-04-15T15:25:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0001d83a0 con 0x7fe00013cd80 2024-04-15T15:25:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fdff4001870 con 0x7fe00013cd80 2024-04-15T15:25:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.220+0000 7fdffcff9640 10 monclient(hunting): dump: 2024-04-15T15:25:04.223 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.221+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 271314736 0 0) 0x7fdfec004eb0 con 0x7fe0000b5a20 2024-04-15T15:25:04.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.221+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0001d8570 con 0x7fe0000b5a20 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.221+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fdff0001bc0 con 0x7fe0000b5a20 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.221+0000 7fdffcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.221+0000 7fdffcff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.221+0000 7fdffcff9640 10 monclient(hunting): dump: 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.225 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.226 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.226 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.226 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3035032479 0 0) 0x7fe00013c680 con 0x7fe00013d200 2024-04-15T15:25:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 >> v1:172.21.15.38:6790/0 conn(0x7fe00013cd80 legacy=0x7fe00013b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 >> v1:172.21.15.38:6789/0 conn(0x7fe0000b5a20 legacy=0x7fe0001d8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 10 monclient: _finish_hunting 0 2024-04-15T15:25:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 1 monclient: found mon.b 2024-04-15T15:25:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00013c850 con 0x7fe00013d200 2024-04-15T15:25:04.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 10 monclient: _finish_auth 0 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 10 monclient: _check_auth_tickets 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fdffcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fe006559640 5 monclient: authenticate success, global_id 32359 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fe006559640 10 monclient: _renew_subs 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fe006559640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0001398b0 con 0x7fe00013d200 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fe006559640 10 client.32359.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fe006559640 10 monclient: _renew_subs 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fe006559640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe000139d80 con 0x7fe00013d200 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.223+0000 7fe006559640 1 librados: init done 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.224+0000 7fe006559640 10 client.32359.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.224+0000 7fe006559640 15 client.32359.objecter _session_command_op_assign -1 1 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.224+0000 7fe006559640 20 client.32359.objecter _get_session osd=-1 returning homeless 2024-04-15T15:25:04.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.224+0000 7fe006559640 10 client.32359.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:04.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.224+0000 7fe006559640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.224+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.164:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe000077050 con 0x7fe00013d200 2024-04-15T15:25:04.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.241+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe000077050 con 0x7fe00013d200 2024-04-15T15:25:04.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.241+0000 7fdffcff9640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:04.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.241+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fdff8004d00 con 0x7fe00013d200 2024-04-15T15:25:04.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.241+0000 7fdffcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:04.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.241+0000 7fdffcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:04.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.241+0000 7fdffcff9640 10 monclient: dump: 2024-04-15T15:25:04.244 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.244 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.241+0000 7fdffe7fc640 4 set_mon_vals no callback set 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.242+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fdff801b230 con 0x7fe00013d200 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.242+0000 7fdffffff640 10 monclient: get_auth_request con 0x7fdfec06ef70 auth_method 0 2024-04-15T15:25:04.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.243+0000 7fdffcff9640 10 client.32359.objecter ms_handle_connect 0x7fdfec06ef70 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.243+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 660..996) ==== 5226+0+0 (unknown 2702740487 0 0) 0x7fdff8053360 con 0x7fe00013d200 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.243+0000 7fdffcff9640 10 client.32359.objecter ms_dispatch 0x7fe000000b90 osd_map(996..996 src has 660..996) 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.243+0000 7fdffcff9640 3 client.32359.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.243+0000 7fdffcff9640 3 client.32359.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 10 client.32359.objecter checking command 1 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 20 client.32359.objecter _get_session s=0x7fdfec077210 osd=7 3 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 20 client.32359.objecter put_session s=0x7fdfec077210 osd=7 3 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 15 client.32359.objecter _session_command_op_remove -1 1 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 20 client.32359.objecter _get_session s=0x7fdfec077210 osd=7 3 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 20 client.32359.objecter get_session s=0x7fdfec077210 osd=7 3 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 15 client.32359.objecter _session_command_op_assign 7 1 2024-04-15T15:25:04.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 20 client.32359.objecter put_session s=0x7fdfec077210 osd=7 4 2024-04-15T15:25:04.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 10 client.32359.objecter _send_command 1 2024-04-15T15:25:04.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.164:6800/3353977755 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfec07b530 con 0x7fdfec0778c0 2024-04-15T15:25:04.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 20 client.32359.objecter dump_active .. 0 homeless 2024-04-15T15:25:04.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_get_version_reply(handle=1 version=996) ==== 24+0+0 (unknown 1347525425 0 0) 0x7fdff8051270 con 0x7fe00013d200 2024-04-15T15:25:04.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdffcff9640 10 monclient: handle_get_version_reply finishing 1 version 996 2024-04-15T15:25:04.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.244+0000 7fdfff7fe640 10 monclient: get_auth_request con 0x7fdfec0778c0 auth_method 0 2024-04-15T15:25:04.248 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.246+0000 7fdffcff9640 10 client.32359.objecter ms_handle_connect 0x7fdfec0778c0 2024-04-15T15:25:04.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.270+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== osd.7 v1:172.21.15.164:6800/3353977755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fdfec07b530 con 0x7fdfec0778c0 2024-04-15T15:25:04.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.270+0000 7fdffcff9640 10 client.32359.objecter ms_dispatch 0x7fe000000b90 command_reply(tid 1: 0 ) 2024-04-15T15:25:04.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.270+0000 7fdffcff9640 10 client.32359.objecter _finish_command 1 = system:0 2024-04-15T15:25:04.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.270+0000 7fdffcff9640 20 client.32359.objecter put_session s=0x7fdfec077210 osd=7 4 2024-04-15T15:25:04.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.270+0000 7fdffcff9640 15 client.32359.objecter _session_command_op_remove 7 1 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 10 client.32359.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 15 client.32359.objecter _session_command_op_assign -1 2 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 20 client.32359.objecter _get_session s=0x7fdfec077210 osd=7 3 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 20 client.32359.objecter put_session s=0x7fdfec077210 osd=7 3 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 20 client.32359.objecter _get_session s=0x7fdfec077210 osd=7 3 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 15 client.32359.objecter _session_command_op_remove -1 2 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 20 client.32359.objecter get_session s=0x7fdfec077210 osd=7 3 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 15 client.32359.objecter _session_command_op_assign 7 2 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 20 client.32359.objecter put_session s=0x7fdfec077210 osd=7 4 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 10 client.32359.objecter _send_command 2 2024-04-15T15:25:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.283+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 --> v1:172.21.15.164:6800/3353977755 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe00013a070 con 0x7fdfec0778c0 2024-04-15T15:25:04.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fdffcff9640 1 -- 172.21.15.38:0/2948995731 <== osd.7 v1:172.21.15.164:6800/3353977755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe00013a070 con 0x7fdfec0778c0 2024-04-15T15:25:04.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fdffcff9640 10 client.32359.objecter ms_dispatch 0x7fe000000b90 command_reply(tid 2: 0 ) 2024-04-15T15:25:04.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fdffcff9640 10 client.32359.objecter _finish_command 2 = system:0 2024-04-15T15:25:04.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fdffcff9640 20 client.32359.objecter put_session s=0x7fdfec077210 osd=7 4 2024-04-15T15:25:04.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fdffcff9640 15 client.32359.objecter _session_command_op_remove 7 2 2024-04-15T15:25:04.299 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-15T15:25:04.299 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T15:25:04.299 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-15T15:25:04.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 10 librados: watch_flush enter 2024-04-15T15:25:04.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 10 librados: watch_flush exit 2024-04-15T15:25:04.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 10 client.32359.objecter close_session for osd.7 2024-04-15T15:25:04.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 >> v1:172.21.15.164:6800/3353977755 conn(0x7fdfec0778c0 legacy=0x7fdfec079d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 20 client.32359.objecter put_session s=0x7fdfec077210 osd=7 1 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 20 client.32359.objecter shutdown clearing up homeless session... 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 10 client.32359.objecter successfully canceled tick 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 >> v1:172.21.15.38:6800/1608957829 conn(0x7fdfec06ef70 legacy=0x7fdfec071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 10 monclient: shutdown 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 >> v1:172.21.15.164:6789/0 conn(0x7fe00013d200 legacy=0x7fe00013bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe004af6640 1 -- 172.21.15.38:0/2948995731 reap_dead start 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 shutdown_connections 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 >> 172.21.15.38:0/2948995731 conn(0x7fe000067790 msgr2=0x7fe000067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 shutdown_connections 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 1 -- 172.21.15.38:0/2948995731 wait complete. 2024-04-15T15:25:04.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.297+0000 7fe006559640 1 librados: shutdown 2024-04-15T15:25:04.309 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-15T15:25:04.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.413+0000 7f39518eb640 10 monclient: get_monmap_and_config 2024-04-15T15:25:04.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.413+0000 7f39518eb640 10 monclient: build_initial_monmap 2024-04-15T15:25:04.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.413+0000 7f39518eb640 10 monclient: monmap: 2024-04-15T15:25:04.415 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:04.415 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.415 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:04.414566+0000 2024-04-15T15:25:04.415 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:04.414566+0000 2024-04-15T15:25:04.415 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:04.415 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.416 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:04.416 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:04.416 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:04.416 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.414+0000 7f39518eb640 1 Processor -- start 2024-04-15T15:25:04.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.414+0000 7f39518eb640 1 -- start start 2024-04-15T15:25:04.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.414+0000 7f39518eb640 10 monclient: init 2024-04-15T15:25:04.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:04.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T15:25:04.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 10 monclient(hunting): picked mon.noname-c con 0x7f394c0b56f0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:04.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 10 monclient(hunting): picked mon.noname-a con 0x7f394c140480 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:04.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 10 monclient(hunting): picked mon.noname-b con 0x7f394c146dd0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:04.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c0ac230 con 0x7f394c140480 2024-04-15T15:25:04.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c0aac50 con 0x7f394c0b56f0 2024-04-15T15:25:04.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c0ab170 con 0x7f394c146dd0 2024-04-15T15:25:04.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:04.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f39518eb640 10 monclient(hunting): authenticate will time out at 2964.685568s 2024-04-15T15:25:04.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f394b7fe640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f394c146dd0 0x7f394c14ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:49998/0 (socket says 172.21.15.38:49998) 2024-04-15T15:25:04.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f394affd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f394c0b56f0 0x7f394c0aa460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:56548/0 (socket says 172.21.15.38:56548) 2024-04-15T15:25:04.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.415+0000 7f394b7fe640 1 -- 172.21.15.38:0/4122774921 learned_addr learned my addr 172.21.15.38:0/4122774921 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.417+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370751351 0 0) 0x7f394c0aac50 con 0x7f394c0b56f0 2024-04-15T15:25:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.417+0000 7f3949ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.417+0000 7f3949ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.417+0000 7f3949ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.417+0000 7f3949ffb640 10 monclient(hunting): my global_id is 32362 2024-04-15T15:25:04.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.417+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3938003520 con 0x7f394c0b56f0 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889664906 0 0) 0x7f394c0ab170 con 0x7f394c146dd0 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 10 monclient(hunting): my global_id is 81110 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f394c0aac50 con 0x7f394c146dd0 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 178453678 0 0) 0x7f394c0ac230 con 0x7f394c140480 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 10 monclient(hunting): my global_id is 33642 2024-04-15T15:25:04.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.418+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f394c0ab170 con 0x7f394c140480 2024-04-15T15:25:04.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 481314773 0 0) 0x7f3938003520 con 0x7f394c0b56f0 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 >> v1:172.21.15.38:6790/0 conn(0x7f394c146dd0 legacy=0x7f394c14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 >> v1:172.21.15.38:6789/0 conn(0x7f394c140480 legacy=0x7f394c1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 10 monclient: _finish_hunting 0 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 1 monclient: found mon.noname-c 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c0b5ad0 con 0x7f394c0b56f0 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 10 monclient: _finish_auth 0 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f39518eb640 5 monclient: authenticate success, global_id 32362 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f393c001610 con 0x7f394c0b56f0 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f39518eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:04.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f3949ffb640 10 monclient: dump: 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.421+0000 7f39518eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.422+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 <== mon.1 v1:172.21.15.164:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f393c001870 con 0x7f394c0b56f0 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.422+0000 7f3949ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.422+0000 7f39518eb640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.422+0000 7f3949ffb640 1 -- 172.21.15.38:0/4122774921 <== mon.1 v1:172.21.15.164:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f393c001c40 con 0x7f394c0b56f0 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.422+0000 7f39518eb640 4 set_mon_vals no callback set 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.422+0000 7f3949ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.422+0000 7f3949ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.422+0000 7f3949ffb640 10 monclient: dump: 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.426 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.423+0000 7f39518eb640 10 monclient: shutdown 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.423+0000 7f39518eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.423+0000 7f39518eb640 1 -- 172.21.15.38:0/4122774921 >> v1:172.21.15.164:6789/0 conn(0x7f394c0b56f0 legacy=0x7f394c0aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.423+0000 7f39518eb640 1 -- 172.21.15.38:0/4122774921 shutdown_connections 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.423+0000 7f39518eb640 1 -- 172.21.15.38:0/4122774921 >> 172.21.15.38:0/4122774921 conn(0x7f394c067790 msgr2=0x7f394c067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.423+0000 7f39518eb640 1 -- 172.21.15.38:0/4122774921 shutdown_connections 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.423+0000 7f39518eb640 1 -- 172.21.15.38:0/4122774921 wait complete. 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.424+0000 7f39518eb640 10 monclient: build_initial_monmap 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.424+0000 7f39518eb640 10 monclient: monmap: 2024-04-15T15:25:04.427 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.424+0000 7f39518eb640 1 librados: starting msgr at 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.424+0000 7f39518eb640 1 librados: starting objecter 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.424+0000 7f39518eb640 1 Processor -- start 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.424+0000 7f39518eb640 1 -- start start 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.424+0000 7f39518eb640 1 librados: setting wanted keys 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.424+0000 7f39518eb640 1 librados: calling monclient init 2024-04-15T15:25:04.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.424+0000 7f39518eb640 10 monclient: init 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 10 monclient(hunting): picked mon.noname-b con 0x7f394c0b56f0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 10 monclient(hunting): picked mon.noname-c con 0x7f394c140480 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 10 monclient(hunting): picked mon.noname-a con 0x7f394c146dd0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c139870 con 0x7f394c146dd0 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c0ae7d0 con 0x7f394c0b56f0 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c0aeab0 con 0x7f394c140480 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.425+0000 7f39518eb640 10 monclient(hunting): authenticate will time out at 2964.695979s 2024-04-15T15:25:04.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.426+0000 7f394affd640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f394c0b56f0 0x7f394c143fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.38:56552/0 (socket says 172.21.15.38:56552) 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.426+0000 7f394affd640 1 -- 172.21.15.38:0/2021497551 learned_addr learned my addr 172.21.15.38:0/2021497551 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.426+0000 7f3943fff640 10 client.?.objecter ms_handle_connect 0x7f394c0b56f0 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.426+0000 7f3943fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.426+0000 7f3943fff640 10 client.?.objecter ms_handle_connect 0x7f394c146dd0 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.426+0000 7f3943fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.426+0000 7f3943fff640 10 client.?.objecter ms_handle_connect 0x7f394c140480 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.426+0000 7f3943fff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002340704 0 0) 0x7f394c0ae7d0 con 0x7f394c0b56f0 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): my global_id is 32365 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f392c004eb0 con 0x7f394c0b56f0 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329156616 0 0) 0x7f394c0aeab0 con 0x7f394c140480 2024-04-15T15:25:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): my global_id is 81113 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f394c0ae7d0 con 0x7f394c140480 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3137108454 0 0) 0x7f394c139870 con 0x7f394c146dd0 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 10 monclient(hunting): my global_id is 33645 2024-04-15T15:25:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.428+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f394c0aeab0 con 0x7f394c146dd0 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.432+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 820640703 0 0) 0x7f392c004eb0 con 0x7f394c0b56f0 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.432+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f394c139870 con 0x7f394c0b56f0 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.432+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f393c001bc0 con 0x7f394c0b56f0 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.432+0000 7f3943fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.432+0000 7f3943fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.432+0000 7f3943fff640 10 monclient(hunting): dump: 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.434 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.435 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.435 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.435 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.435 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.435 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.435 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.432+0000 7f3943fff640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:04.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3132631094 0 0) 0x7f394c0ae7d0 con 0x7f394c140480 2024-04-15T15:25:04.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f392c004eb0 con 0x7f394c140480 2024-04-15T15:25:04.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f39340018b0 con 0x7f394c140480 2024-04-15T15:25:04.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:04.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:04.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 10 monclient(hunting): dump: 2024-04-15T15:25:04.436 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.436 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 471875754 0 0) 0x7f394c0aeab0 con 0x7f394c146dd0 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f394c0ae7d0 con 0x7f394c146dd0 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f3944001b50 con 0x7f394c146dd0 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.434+0000 7f3943fff640 10 monclient(hunting): dump: 2024-04-15T15:25:04.437 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.438 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.438 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.438 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.438 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.438 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.438 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.438 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.438 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.438 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.1 v1:172.21.15.164:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1745062572 0 0) 0x7f394c139870 con 0x7f394c0b56f0 2024-04-15T15:25:04.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 >> v1:172.21.15.38:6790/0 conn(0x7f394c140480 legacy=0x7f394c138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 >> v1:172.21.15.38:6789/0 conn(0x7f394c146dd0 legacy=0x7f394c139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 10 monclient: _finish_hunting 0 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 1 monclient: found mon.b 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c0aed90 con 0x7f394c0b56f0 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 10 monclient: _finish_auth 0 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 10 monclient: _check_auth_tickets 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f3943fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f39518eb640 5 monclient: authenticate success, global_id 32365 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f39518eb640 10 monclient: _renew_subs 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f39518eb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.164:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f394c0acbf0 con 0x7f394c0b56f0 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f39518eb640 10 client.32365.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:04.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f39518eb640 10 monclient: _renew_subs 2024-04-15T15:25:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f39518eb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.164:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f394c0ad320 con 0x7f394c0b56f0 2024-04-15T15:25:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.436+0000 7f39518eb640 1 librados: init done 2024-04-15T15:25:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.437+0000 7f39518eb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.437+0000 7f39518eb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.437+0000 7f39518eb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.164:6789/0 2024-04-15T15:25:04.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.437+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.164:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394c0b2990 con 0x7f394c0b56f0 2024-04-15T15:25:04.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.451+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.1 v1:172.21.15.164:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f393c001870 con 0x7f394c0b56f0 2024-04-15T15:25:04.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.451+0000 7f3943fff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:04.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.451+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.1 v1:172.21.15.164:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f393c004b30 con 0x7f394c0b56f0 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.451+0000 7f3943fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.451+0000 7f3943fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.451+0000 7f3943fff640 10 monclient: dump: 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:04.453 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:04.454 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:04.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.451+0000 7f39497fa640 4 set_mon_vals no callback set 2024-04-15T15:25:04.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.452+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.1 v1:172.21.15.164:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f393c01b060 con 0x7f394c0b56f0 2024-04-15T15:25:04.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.452+0000 7f394a7fc640 10 monclient: get_auth_request con 0x7f392c06eed0 auth_method 0 2024-04-15T15:25:04.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.452+0000 7f3943fff640 10 client.32365.objecter ms_handle_connect 0x7f392c06eed0 2024-04-15T15:25:04.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.453+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.1 v1:172.21.15.164:6789/0 8 ==== osd_map(996..996 src has 660..996) ==== 5226+0+0 (unknown 2702740487 0 0) 0x7f393c053240 con 0x7f394c0b56f0 2024-04-15T15:25:04.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.453+0000 7f3943fff640 10 client.32365.objecter ms_dispatch 0x7f394c000b90 osd_map(996..996 src has 660..996) 2024-04-15T15:25:04.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.453+0000 7f3943fff640 3 client.32365.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:04.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.453+0000 7f3943fff640 3 client.32365.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:04.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.453+0000 7f3943fff640 20 client.32365.objecter dump_active .. 0 homeless 2024-04-15T15:25:04.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.692+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mon.1 v1:172.21.15.164:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f393c055640 con 0x7f394c0b56f0 2024-04-15T15:25:04.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.692+0000 7f3943fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:04.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.692+0000 7f3943fff640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:25:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.882+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f394c077050 con 0x7f392c06eed0 2024-04-15T15:25:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.882+0000 7f3943fff640 1 -- 172.21.15.38:0/2021497551 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (unknown 1239724482 0 0) 0x7f394c077050 con 0x7f392c06eed0 2024-04-15T15:25:04.884 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 7 to deep-scrub 2024-04-15T15:25:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 10 librados: watch_flush enter 2024-04-15T15:25:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 10 librados: watch_flush exit 2024-04-15T15:25:04.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 20 client.32365.objecter shutdown clearing up homeless session... 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 10 client.32365.objecter successfully canceled tick 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 >> v1:172.21.15.38:6800/1608957829 conn(0x7f392c06eed0 legacy=0x7f392c071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 10 monclient: shutdown 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 >> v1:172.21.15.164:6789/0 conn(0x7f394c0b56f0 legacy=0x7f394c143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 shutdown_connections 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.884+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 >> 172.21.15.38:0/2021497551 conn(0x7f394c067790 msgr2=0x7f394c145b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.885+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 shutdown_connections 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.885+0000 7f39518eb640 1 -- 172.21.15.38:0/2021497551 wait complete. 2024-04-15T15:25:04.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:04.885+0000 7f39518eb640 1 librados: shutdown 2024-04-15T15:25:04.897 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.001+0000 7f705b57c640 10 monclient: get_monmap_and_config 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.001+0000 7f705b57c640 10 monclient: build_initial_monmap 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.001+0000 7f705b57c640 10 monclient: monmap: 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:05.002426+0000 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:05.002426+0000 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:05.003 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:05.004 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.002+0000 7f705b57c640 1 Processor -- start 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.002+0000 7f705b57c640 1 -- start start 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.002+0000 7f705b57c640 10 monclient: init 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 10 monclient: _add_conns ranks=[2,1,0] 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 10 monclient(hunting): picked mon.noname-b con 0x7f70540b57d0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 10 monclient(hunting): picked mon.noname-c con 0x7f70540b5bb0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 10 monclient(hunting): picked mon.noname-a con 0x7f7054140b30 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7054146e10 con 0x7f7054140b30 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70540aa840 con 0x7f70540b5bb0 2024-04-15T15:25:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70540aa460 con 0x7f70540b57d0 2024-04-15T15:25:05.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:05.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.003+0000 7f705b57c640 10 monclient(hunting): authenticate will time out at 2965.273549s 2024-04-15T15:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.030+0000 7f7059b19640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7054140b30 0x7f705414ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44456/0 (socket says 172.21.15.38:44456) 2024-04-15T15:25:05.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.030+0000 7f7059b19640 1 -- 172.21.15.38:0/1357941600 learned_addr learned my addr 172.21.15.38:0/1357941600 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:05.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.033+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677415932 0 0) 0x7f7054146e10 con 0x7f7054140b30 2024-04-15T15:25:05.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.033+0000 7f704bfff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.033+0000 7f704bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.033+0000 7f704bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.033+0000 7f704bfff640 10 monclient(hunting): my global_id is 33648 2024-04-15T15:25:05.035 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.033+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7040003520 con 0x7f7054140b30 2024-04-15T15:25:05.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.035+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79263873 0 0) 0x7f70540aa460 con 0x7f70540b57d0 2024-04-15T15:25:05.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.035+0000 7f704bfff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:05.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.035+0000 7f704bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:05.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.035+0000 7f704bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:05.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.035+0000 7f704bfff640 10 monclient(hunting): my global_id is 81116 2024-04-15T15:25:05.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.035+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7054146e10 con 0x7f70540b57d0 2024-04-15T15:25:05.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2411920458 0 0) 0x7f7040003520 con 0x7f7054140b30 2024-04-15T15:25:05.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 >> v1:172.21.15.38:6790/0 conn(0x7f70540b57d0 legacy=0x7f7054146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:05.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 >> v1:172.21.15.164:6789/0 conn(0x7f70540b5bb0 legacy=0x7f7054140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-15T15:25:05.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 10 monclient: _finish_hunting 0 2024-04-15T15:25:05.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 1 monclient: found mon.noname-a 2024-04-15T15:25:05.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:05.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T15:25:05.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70540b2970 con 0x7f7054140b30 2024-04-15T15:25:05.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 10 monclient: _finish_auth 0 2024-04-15T15:25:05.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 10 monclient: _check_auth_tickets 2024-04-15T15:25:05.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:05.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f704c001990 con 0x7f7054140b30 2024-04-15T15:25:05.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:05.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T15:25:05.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f704bfff640 10 monclient: dump: 2024-04-15T15:25:05.041 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:05.041 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:05.041 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.041 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.041 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:05.041 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:05.041 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:05.042 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:05.042 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:05.042 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:05.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f705b57c640 5 monclient: authenticate success, global_id 33648 2024-04-15T15:25:05.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.036+0000 7f705b57c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:05.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.039+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f704c001bf0 con 0x7f7054140b30 2024-04-15T15:25:05.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.039+0000 7f704bfff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:05.047 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.039+0000 7f704bfff640 1 -- 172.21.15.38:0/1357941600 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f704c001fc0 con 0x7f7054140b30 2024-04-15T15:25:05.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.039+0000 7f704bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:05.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.039+0000 7f704bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:05.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.039+0000 7f704bfff640 10 monclient: dump: 2024-04-15T15:25:05.048 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:05.048 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:05.048 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.048 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.049 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:05.049 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:05.049 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:05.049 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:05.049 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:05.049 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:05.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.039+0000 7f705b57c640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:05.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.039+0000 7f705b57c640 4 set_mon_vals no callback set 2024-04-15T15:25:05.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.040+0000 7f705b57c640 10 monclient: shutdown 2024-04-15T15:25:05.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.040+0000 7f705b57c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:05.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.040+0000 7f705b57c640 1 -- 172.21.15.38:0/1357941600 >> v1:172.21.15.38:6789/0 conn(0x7f7054140b30 legacy=0x7f705414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:05.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.040+0000 7f705b57c640 1 -- 172.21.15.38:0/1357941600 shutdown_connections 2024-04-15T15:25:05.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.040+0000 7f705b57c640 1 -- 172.21.15.38:0/1357941600 >> 172.21.15.38:0/1357941600 conn(0x7f7054067790 msgr2=0x7f7054067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.040+0000 7f705b57c640 1 -- 172.21.15.38:0/1357941600 shutdown_connections 2024-04-15T15:25:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.040+0000 7f705b57c640 1 -- 172.21.15.38:0/1357941600 wait complete. 2024-04-15T15:25:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.041+0000 7f705b57c640 10 monclient: build_initial_monmap 2024-04-15T15:25:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.041+0000 7f705b57c640 10 monclient: monmap: 2024-04-15T15:25:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:05.051 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.041+0000 7f705b57c640 1 librados: starting msgr at 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.041+0000 7f705b57c640 1 librados: starting objecter 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.041+0000 7f705b57c640 1 Processor -- start 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.041+0000 7f705b57c640 1 -- start start 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.041+0000 7f705b57c640 1 librados: setting wanted keys 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.041+0000 7f705b57c640 1 librados: calling monclient init 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.041+0000 7f705b57c640 10 monclient: init 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:05.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 10 monclient(hunting): picked mon.noname-a con 0x7f70540b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 10 monclient(hunting): picked mon.noname-b con 0x7f70540b5bb0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 10 monclient(hunting): picked mon.noname-c con 0x7f7054140b30 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70541dc890 con 0x7f70540b57d0 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70541dbc60 con 0x7f70540b5bb0 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7054141000 con 0x7f7054140b30 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f705b57c640 10 monclient(hunting): authenticate will time out at 2965.312494s 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f7059318640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f70540b57d0 0x7f70541dc180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:44472/0 (socket says 172.21.15.38:44472) 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f7059b19640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7f7054140b30 0x7f70541e3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:50028/0 (socket says 172.21.15.38:50028) 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f7059318640 1 -- 172.21.15.38:0/1012299231 learned_addr learned my addr 172.21.15.38:0/1012299231 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f7049ffb640 10 client.?.objecter ms_handle_connect 0x7f70540b57d0 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f7049ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f7049ffb640 10 client.?.objecter ms_handle_connect 0x7f7054140b30 2024-04-15T15:25:05.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.042+0000 7f7049ffb640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.044+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2182505184 0 0) 0x7f7054141000 con 0x7f7054140b30 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.044+0000 7f7049ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.044+0000 7f7049ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.044+0000 7f7049ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.044+0000 7f7049ffb640 10 monclient(hunting): my global_id is 81119 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.044+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7038004eb0 con 0x7f7054140b30 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.045+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972762483 0 0) 0x7f70541dc890 con 0x7f70540b57d0 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.045+0000 7f7049ffb640 10 monclient(hunting): _negotiate 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.045+0000 7f7049ffb640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.045+0000 7f7049ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.045+0000 7f7049ffb640 10 monclient(hunting): my global_id is 33651 2024-04-15T15:25:05.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.045+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7054141000 con 0x7f70540b57d0 2024-04-15T15:25:05.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.050+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1909564063 0 0) 0x7f7054141000 con 0x7f70540b57d0 2024-04-15T15:25:05.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.050+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70541dc890 con 0x7f70540b57d0 2024-04-15T15:25:05.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.050+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7050001990 con 0x7f70540b57d0 2024-04-15T15:25:05.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.050+0000 7f7049ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:05.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.050+0000 7f7049ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T15:25:05.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.050+0000 7f7049ffb640 10 monclient(hunting): dump: 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.050+0000 7f7049ffb640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.053+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1423050377 0 0) 0x7f7038004eb0 con 0x7f7054140b30 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.053+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7054141000 con 0x7f7054140b30 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.053+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f704c001f40 con 0x7f7054140b30 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.053+0000 7f7049ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:05.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.053+0000 7f7049ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.053+0000 7f7049ffb640 10 monclient(hunting): dump: 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:05.057 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.0 v1:172.21.15.38:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1583559792 0 0) 0x7f70541dc890 con 0x7f70540b57d0 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 >> v1:172.21.15.38:6790/0 conn(0x7f7054140b30 legacy=0x7f70541e3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 >> v1:172.21.15.164:6789/0 conn(0x7f70540b5bb0 legacy=0x7f7054136d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 10 monclient: _finish_hunting 0 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 1 monclient: found mon.a 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7054141c10 con 0x7f70540b57d0 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 10 monclient: _finish_auth 0 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 10 monclient: _check_auth_tickets 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f7049ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:05.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f705b57c640 5 monclient: authenticate success, global_id 33651 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f705b57c640 10 monclient: _renew_subs 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f705b57c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 --> v1:172.21.15.38:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7054141ec0 con 0x7f70540b57d0 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f705b57c640 10 client.33651.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f705b57c640 10 monclient: _renew_subs 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f705b57c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 --> v1:172.21.15.38:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f705413e090 con 0x7f70540b57d0 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.055+0000 7f705b57c640 1 librados: init done 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.056+0000 7f705b57c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.056+0000 7f705b57c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.056+0000 7f705b57c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.38:6789/0 2024-04-15T15:25:05.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.056+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 --> v1:172.21.15.38:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70540b7600 con 0x7f70540b57d0 2024-04-15T15:25:05.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.274+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.0 v1:172.21.15.38:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7050001c90 con 0x7f70540b57d0 2024-04-15T15:25:05.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.274+0000 7f7049ffb640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:05.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.274+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.0 v1:172.21.15.38:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7f7050003a60 con 0x7f70540b57d0 2024-04-15T15:25:05.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.274+0000 7f7049ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:05.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.274+0000 7f7049ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:05.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.274+0000 7f7049ffb640 10 monclient: dump: 2024-04-15T15:25:05.276 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:05.277 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:05.278 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:05.278 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:05.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.274+0000 7f704b7fe640 4 set_mon_vals no callback set 2024-04-15T15:25:05.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.347+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.0 v1:172.21.15.38:6789/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7f7050003c00 con 0x7f70540b57d0 2024-04-15T15:25:05.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.347+0000 7f7058b17640 10 monclient: get_auth_request con 0x7f703806ed80 auth_method 0 2024-04-15T15:25:05.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.348+0000 7f7049ffb640 10 client.33651.objecter ms_handle_connect 0x7f703806ed80 2024-04-15T15:25:05.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.354+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.0 v1:172.21.15.38:6789/0 8 ==== osd_map(996..996 src has 660..996) ==== 5226+0+0 (unknown 2702740487 0 0) 0x7f7050053510 con 0x7f70540b57d0 2024-04-15T15:25:05.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.354+0000 7f7049ffb640 10 client.33651.objecter ms_dispatch 0x7f7054000b90 osd_map(996..996 src has 660..996) 2024-04-15T15:25:05.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.354+0000 7f7049ffb640 3 client.33651.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:05.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.354+0000 7f7049ffb640 3 client.33651.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:05.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.354+0000 7f7049ffb640 20 client.33651.objecter dump_active .. 0 homeless 2024-04-15T15:25:05.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.354+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mon.0 v1:172.21.15.38:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7f70540b7600 con 0x7f70540b57d0 2024-04-15T15:25:05.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.354+0000 7f7049ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:05.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.354+0000 7f7049ffb640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:25:05.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.540+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7054077050 con 0x7f703806ed80 2024-04-15T15:25:05.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.543+0000 7f7049ffb640 1 -- 172.21.15.38:0/1012299231 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+115677 (unknown 2965378022 0 2992597010) 0x7f7054077050 con 0x7f703806ed80 2024-04-15T15:25:05.546 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T15:25:05.546 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.545+0000 7f705b57c640 10 librados: watch_flush enter 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.545+0000 7f705b57c640 10 librados: watch_flush exit 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.545+0000 7f705b57c640 20 client.33651.objecter shutdown clearing up homeless session... 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.545+0000 7f705b57c640 10 client.33651.objecter successfully canceled tick 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.546+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 >> v1:172.21.15.38:6800/1608957829 conn(0x7f703806ed80 legacy=0x7f7038071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.546+0000 7f705b57c640 10 monclient: shutdown 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.546+0000 7f705b57c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.546+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 >> v1:172.21.15.38:6789/0 conn(0x7f70540b57d0 legacy=0x7f70541dc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.546+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 shutdown_connections 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.546+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 >> 172.21.15.38:0/1012299231 conn(0x7f7054067790 msgr2=0x7f70541cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.546+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 shutdown_connections 2024-04-15T15:25:05.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.546+0000 7f705b57c640 1 -- 172.21.15.38:0/1012299231 wait complete. 2024-04-15T15:25:05.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:05.546+0000 7f705b57c640 1 librados: shutdown 2024-04-15T15:25:05.558 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1764,"stamp":"2024-04-15T15:25:05.186798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":614124,"kb_used_data":59288,"kb_used_omap":12,"kb_used_meta":554739,"kb_avail":754360596,"statfs":{"total":773094113280,"available":772465250304,"internally_reserved":0,"allocated":60710912,"data_stored":28612306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":568053297},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001702"},"pg_stats":[{"pgid":"16.0","version":"0'0","reported_seq":1890,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.092788+0000","last_change":"2024-04-15T15:01:50.438639+0000","last_active":"2024-04-15T15:24:57.092788+0000","last_peered":"2024-04-15T15:24:57.092788+0000","last_clean":"2024-04-15T15:24:57.092788+0000","last_became_active":"2024-04-15T15:01:50.426257+0000","last_became_peered":"2024-04-15T15:01:50.426257+0000","last_unstale":"2024-04-15T15:24:57.092788+0000","last_undegraded":"2024-04-15T15:24:57.092788+0000","last_fullsized":"2024-04-15T15:24:57.092788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:32:49.021840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1","version":"50'7","reported_seq":1911,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.076052+0000","last_change":"2024-04-15T15:01:58.061052+0000","last_active":"2024-04-15T15:24:57.076052+0000","last_peered":"2024-04-15T15:24:57.076052+0000","last_clean":"2024-04-15T15:24:57.076052+0000","last_became_active":"2024-04-15T15:01:58.055451+0000","last_became_peered":"2024-04-15T15:01:58.055451+0000","last_unstale":"2024-04-15T15:24:57.076052+0000","last_undegraded":"2024-04-15T15:24:57.076052+0000","last_fullsized":"2024-04-15T15:24:57.076052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:21:09.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1858,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.782182+0000","last_change":"2024-04-15T15:01:50.838864+0000","last_active":"2024-04-15T15:24:56.782182+0000","last_peered":"2024-04-15T15:24:56.782182+0000","last_clean":"2024-04-15T15:24:56.782182+0000","last_became_active":"2024-04-15T15:01:50.831566+0000","last_became_peered":"2024-04-15T15:01:50.831566+0000","last_unstale":"2024-04-15T15:24:56.782182+0000","last_undegraded":"2024-04-15T15:24:56.782182+0000","last_fullsized":"2024-04-15T15:24:56.782182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1883,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.101013+0000","last_change":"2024-04-15T15:01:37.314165+0000","last_active":"2024-04-15T15:24:57.101013+0000","last_peered":"2024-04-15T15:24:57.101013+0000","last_clean":"2024-04-15T15:24:57.101013+0000","last_became_active":"2024-04-15T15:01:37.307442+0000","last_became_peered":"2024-04-15T15:01:37.307442+0000","last_unstale":"2024-04-15T15:24:57.101013+0000","last_undegraded":"2024-04-15T15:24:57.101013+0000","last_fullsized":"2024-04-15T15:24:57.101013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1886,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.834083+0000","last_change":"2024-04-15T15:01:59.509650+0000","last_active":"2024-04-15T15:24:56.834083+0000","last_peered":"2024-04-15T15:24:56.834083+0000","last_clean":"2024-04-15T15:24:56.834083+0000","last_became_active":"2024-04-15T15:01:59.386200+0000","last_became_peered":"2024-04-15T15:01:59.386200+0000","last_unstale":"2024-04-15T15:24:56.834083+0000","last_undegraded":"2024-04-15T15:24:56.834083+0000","last_fullsized":"2024-04-15T15:24:56.834083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:48:58.277123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1886,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.829456+0000","last_change":"2024-04-15T15:01:59.531768+0000","last_active":"2024-04-15T15:24:56.829456+0000","last_peered":"2024-04-15T15:24:56.829456+0000","last_clean":"2024-04-15T15:24:56.829456+0000","last_became_active":"2024-04-15T15:01:59.475519+0000","last_became_peered":"2024-04-15T15:01:59.475519+0000","last_unstale":"2024-04-15T15:24:56.829456+0000","last_undegraded":"2024-04-15T15:24:56.829456+0000","last_fullsized":"2024-04-15T15:24:56.829456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:03:14.693476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1875,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.110787+0000","last_change":"2024-04-15T15:02:06.546089+0000","last_active":"2024-04-15T15:24:57.110787+0000","last_peered":"2024-04-15T15:24:57.110787+0000","last_clean":"2024-04-15T15:24:57.110787+0000","last_became_active":"2024-04-15T15:02:06.539897+0000","last_became_peered":"2024-04-15T15:02:06.539897+0000","last_unstale":"2024-04-15T15:24:57.110787+0000","last_undegraded":"2024-04-15T15:24:57.110787+0000","last_fullsized":"2024-04-15T15:24:57.110787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1856,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.796440+0000","last_change":"2024-04-15T15:01:56.856132+0000","last_active":"2024-04-15T15:24:56.796440+0000","last_peered":"2024-04-15T15:24:56.796440+0000","last_clean":"2024-04-15T15:24:56.796440+0000","last_became_active":"2024-04-15T15:01:56.846541+0000","last_became_peered":"2024-04-15T15:01:56.846541+0000","last_unstale":"2024-04-15T15:24:56.796440+0000","last_undegraded":"2024-04-15T15:24:56.796440+0000","last_fullsized":"2024-04-15T15:24:56.796440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1903,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.029001+0000","last_change":"2024-04-15T15:01:31.031846+0000","last_active":"2024-04-15T15:24:57.029001+0000","last_peered":"2024-04-15T15:24:57.029001+0000","last_clean":"2024-04-15T15:24:57.029001+0000","last_became_active":"2024-04-15T15:01:31.025154+0000","last_became_peered":"2024-04-15T15:01:31.025154+0000","last_unstale":"2024-04-15T15:24:57.029001+0000","last_undegraded":"2024-04-15T15:24:57.029001+0000","last_fullsized":"2024-04-15T15:24:57.029001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:58.719678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1881,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.094768+0000","last_change":"2024-04-15T15:01:47.686569+0000","last_active":"2024-04-15T15:24:57.094768+0000","last_peered":"2024-04-15T15:24:57.094768+0000","last_clean":"2024-04-15T15:24:57.094768+0000","last_became_active":"2024-04-15T15:01:47.652436+0000","last_became_peered":"2024-04-15T15:01:47.652436+0000","last_unstale":"2024-04-15T15:24:57.094768+0000","last_undegraded":"2024-04-15T15:24:57.094768+0000","last_fullsized":"2024-04-15T15:24:57.094768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1896,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.089239+0000","last_change":"2024-04-15T15:01:58.212389+0000","last_active":"2024-04-15T15:24:57.089239+0000","last_peered":"2024-04-15T15:24:57.089239+0000","last_clean":"2024-04-15T15:24:57.089239+0000","last_became_active":"2024-04-15T15:01:58.198421+0000","last_became_peered":"2024-04-15T15:01:58.198421+0000","last_unstale":"2024-04-15T15:24:57.089239+0000","last_undegraded":"2024-04-15T15:24:57.089239+0000","last_fullsized":"2024-04-15T15:24:57.089239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:07:05.883431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1889,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.756605+0000","last_change":"2024-04-15T15:01:58.537678+0000","last_active":"2024-04-15T15:24:56.756605+0000","last_peered":"2024-04-15T15:24:56.756605+0000","last_clean":"2024-04-15T15:24:56.756605+0000","last_became_active":"2024-04-15T15:01:58.520219+0000","last_became_peered":"2024-04-15T15:01:58.520219+0000","last_unstale":"2024-04-15T15:24:56.756605+0000","last_undegraded":"2024-04-15T15:24:56.756605+0000","last_fullsized":"2024-04-15T15:24:56.756605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1880,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.093425+0000","last_change":"2024-04-15T15:01:48.968180+0000","last_active":"2024-04-15T15:24:57.093425+0000","last_peered":"2024-04-15T15:24:57.093425+0000","last_clean":"2024-04-15T15:24:57.093425+0000","last_became_active":"2024-04-15T15:01:48.927422+0000","last_became_peered":"2024-04-15T15:01:48.927422+0000","last_unstale":"2024-04-15T15:24:57.093425+0000","last_undegraded":"2024-04-15T15:24:57.093425+0000","last_fullsized":"2024-04-15T15:24:57.093425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"996'78","reported_seq":2045,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:59.955958+0000","last_change":"2024-04-15T15:24:59.957323+0000","last_active":"2024-04-15T15:24:59.955958+0000","last_peered":"2024-04-15T15:24:59.955958+0000","last_clean":"2024-04-15T15:24:59.955958+0000","last_became_active":"2024-04-15T14:59:44.414489+0000","last_became_peered":"2024-04-15T14:59:44.414489+0000","last_unstale":"2024-04-15T15:24:59.955958+0000","last_undegraded":"2024-04-15T15:24:59.955958+0000","last_fullsized":"2024-04-15T15:24:59.955958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"996'78","last_scrub_stamp":"2024-04-15T15:24:59.954244+0000","last_deep_scrub":"996'78","last_deep_scrub_stamp":"2024-04-15T15:24:59.954244+0000","last_clean_scrub_stamp":"2024-04-15T15:24:59.954244+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:42:20.898337+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1898,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.102888+0000","last_change":"2024-04-15T14:59:53.285621+0000","last_active":"2024-04-15T15:24:57.102888+0000","last_peered":"2024-04-15T15:24:57.102888+0000","last_clean":"2024-04-15T15:24:57.102888+0000","last_became_active":"2024-04-15T14:59:53.276305+0000","last_became_peered":"2024-04-15T14:59:53.276305+0000","last_unstale":"2024-04-15T15:24:57.102888+0000","last_undegraded":"2024-04-15T15:24:57.102888+0000","last_fullsized":"2024-04-15T15:24:57.102888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1892,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.759598+0000","last_change":"2024-04-15T15:01:50.074053+0000","last_active":"2024-04-15T15:24:56.759598+0000","last_peered":"2024-04-15T15:24:56.759598+0000","last_clean":"2024-04-15T15:24:56.759598+0000","last_became_active":"2024-04-15T15:01:50.052081+0000","last_became_peered":"2024-04-15T15:01:50.052081+0000","last_unstale":"2024-04-15T15:24:56.759598+0000","last_undegraded":"2024-04-15T15:24:56.759598+0000","last_fullsized":"2024-04-15T15:24:56.759598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1898,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.096676+0000","last_change":"2024-04-15T14:59:52.944781+0000","last_active":"2024-04-15T15:24:57.096676+0000","last_peered":"2024-04-15T15:24:57.096676+0000","last_clean":"2024-04-15T15:24:57.096676+0000","last_became_active":"2024-04-15T14:59:52.908707+0000","last_became_peered":"2024-04-15T14:59:52.908707+0000","last_unstale":"2024-04-15T15:24:57.096676+0000","last_undegraded":"2024-04-15T15:24:57.096676+0000","last_fullsized":"2024-04-15T15:24:57.096676+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1902,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.051265+0000","last_change":"2024-04-15T15:01:38.091528+0000","last_active":"2024-04-15T15:24:57.051265+0000","last_peered":"2024-04-15T15:24:57.051265+0000","last_clean":"2024-04-15T15:24:57.051265+0000","last_became_active":"2024-04-15T15:01:37.900280+0000","last_became_peered":"2024-04-15T15:01:37.900280+0000","last_unstale":"2024-04-15T15:24:57.051265+0000","last_undegraded":"2024-04-15T15:24:57.051265+0000","last_fullsized":"2024-04-15T15:24:57.051265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:55:41.178094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1915,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.031370+0000","last_change":"2024-04-15T14:59:52.865828+0000","last_active":"2024-04-15T15:24:57.031370+0000","last_peered":"2024-04-15T15:24:57.031370+0000","last_clean":"2024-04-15T15:24:57.031370+0000","last_became_active":"2024-04-15T14:59:52.828831+0000","last_became_peered":"2024-04-15T14:59:52.828831+0000","last_unstale":"2024-04-15T15:24:57.031370+0000","last_undegraded":"2024-04-15T15:24:57.031370+0000","last_fullsized":"2024-04-15T15:24:57.031370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:49:13.712376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1897,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.070801+0000","last_change":"2024-04-15T15:01:57.832637+0000","last_active":"2024-04-15T15:24:57.070801+0000","last_peered":"2024-04-15T15:24:57.070801+0000","last_clean":"2024-04-15T15:24:57.070801+0000","last_became_active":"2024-04-15T15:01:57.822039+0000","last_became_peered":"2024-04-15T15:01:57.822039+0000","last_unstale":"2024-04-15T15:24:57.070801+0000","last_undegraded":"2024-04-15T15:24:57.070801+0000","last_fullsized":"2024-04-15T15:24:57.070801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:36:46.591238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1898,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.105840+0000","last_change":"2024-04-15T14:59:53.222610+0000","last_active":"2024-04-15T15:24:57.105840+0000","last_peered":"2024-04-15T15:24:57.105840+0000","last_clean":"2024-04-15T15:24:57.105840+0000","last_became_active":"2024-04-15T14:59:53.217062+0000","last_became_peered":"2024-04-15T14:59:53.217062+0000","last_unstale":"2024-04-15T15:24:57.105840+0000","last_undegraded":"2024-04-15T15:24:57.105840+0000","last_fullsized":"2024-04-15T15:24:57.105840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1900,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.068279+0000","last_change":"2024-04-15T15:01:44.637457+0000","last_active":"2024-04-15T15:24:57.068279+0000","last_peered":"2024-04-15T15:24:57.068279+0000","last_clean":"2024-04-15T15:24:57.068279+0000","last_became_active":"2024-04-15T15:01:44.538256+0000","last_became_peered":"2024-04-15T15:01:44.538256+0000","last_unstale":"2024-04-15T15:24:57.068279+0000","last_undegraded":"2024-04-15T15:24:57.068279+0000","last_fullsized":"2024-04-15T15:24:57.068279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:29:56.488170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1901,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.106245+0000","last_change":"2024-04-15T14:59:53.268620+0000","last_active":"2024-04-15T15:24:57.106245+0000","last_peered":"2024-04-15T15:24:57.106245+0000","last_clean":"2024-04-15T15:24:57.106245+0000","last_became_active":"2024-04-15T14:59:53.236225+0000","last_became_peered":"2024-04-15T14:59:53.236225+0000","last_unstale":"2024-04-15T15:24:57.106245+0000","last_undegraded":"2024-04-15T15:24:57.106245+0000","last_fullsized":"2024-04-15T15:24:57.106245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:02:24.955207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1885,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.852082+0000","last_change":"2024-04-15T15:01:59.581889+0000","last_active":"2024-04-15T15:24:56.852082+0000","last_peered":"2024-04-15T15:24:56.852082+0000","last_clean":"2024-04-15T15:24:56.852082+0000","last_became_active":"2024-04-15T15:01:59.575852+0000","last_became_peered":"2024-04-15T15:01:59.575852+0000","last_unstale":"2024-04-15T15:24:56.852082+0000","last_undegraded":"2024-04-15T15:24:56.852082+0000","last_fullsized":"2024-04-15T15:24:56.852082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:13:33.644867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1897,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.111768+0000","last_change":"2024-04-15T14:59:53.006767+0000","last_active":"2024-04-15T15:24:57.111768+0000","last_peered":"2024-04-15T15:24:57.111768+0000","last_clean":"2024-04-15T15:24:57.111768+0000","last_became_active":"2024-04-15T14:59:53.001226+0000","last_became_peered":"2024-04-15T14:59:53.001226+0000","last_unstale":"2024-04-15T15:24:57.111768+0000","last_undegraded":"2024-04-15T15:24:57.111768+0000","last_fullsized":"2024-04-15T15:24:57.111768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1887,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.835822+0000","last_change":"2024-04-15T15:01:53.665706+0000","last_active":"2024-04-15T15:24:56.835822+0000","last_peered":"2024-04-15T15:24:56.835822+0000","last_clean":"2024-04-15T15:24:56.835822+0000","last_became_active":"2024-04-15T15:01:53.660325+0000","last_became_peered":"2024-04-15T15:01:53.660325+0000","last_unstale":"2024-04-15T15:24:56.835822+0000","last_undegraded":"2024-04-15T15:24:56.835822+0000","last_fullsized":"2024-04-15T15:24:56.835822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:05:10.873866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1911,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.850121+0000","last_change":"2024-04-15T14:59:53.351131+0000","last_active":"2024-04-15T15:24:56.850121+0000","last_peered":"2024-04-15T15:24:56.850121+0000","last_clean":"2024-04-15T15:24:56.850121+0000","last_became_active":"2024-04-15T14:59:53.319031+0000","last_became_peered":"2024-04-15T14:59:53.319031+0000","last_unstale":"2024-04-15T15:24:56.850121+0000","last_undegraded":"2024-04-15T15:24:56.850121+0000","last_fullsized":"2024-04-15T15:24:56.850121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:02:06.831069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1902,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.057749+0000","last_change":"2024-04-15T15:01:36.591333+0000","last_active":"2024-04-15T15:24:57.057749+0000","last_peered":"2024-04-15T15:24:57.057749+0000","last_clean":"2024-04-15T15:24:57.057749+0000","last_became_active":"2024-04-15T15:01:36.581212+0000","last_became_peered":"2024-04-15T15:01:36.581212+0000","last_unstale":"2024-04-15T15:24:57.057749+0000","last_undegraded":"2024-04-15T15:24:57.057749+0000","last_fullsized":"2024-04-15T15:24:57.057749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:25:08.293854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1895,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.118060+0000","last_change":"2024-04-15T14:59:53.315692+0000","last_active":"2024-04-15T15:24:57.118060+0000","last_peered":"2024-04-15T15:24:57.118060+0000","last_clean":"2024-04-15T15:24:57.118060+0000","last_became_active":"2024-04-15T14:59:53.310268+0000","last_became_peered":"2024-04-15T14:59:53.310268+0000","last_unstale":"2024-04-15T15:24:57.118060+0000","last_undegraded":"2024-04-15T15:24:57.118060+0000","last_fullsized":"2024-04-15T15:24:57.118060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T14:59:51.350288+0000","last_clean_scrub_stamp":"2024-04-15T14:59:51.350288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1886,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.853823+0000","last_change":"2024-04-15T15:01:53.629947+0000","last_active":"2024-04-15T15:24:56.853823+0000","last_peered":"2024-04-15T15:24:56.853823+0000","last_clean":"2024-04-15T15:24:56.853823+0000","last_became_active":"2024-04-15T15:01:53.609717+0000","last_became_peered":"2024-04-15T15:01:53.609717+0000","last_unstale":"2024-04-15T15:24:56.853823+0000","last_undegraded":"2024-04-15T15:24:56.853823+0000","last_fullsized":"2024-04-15T15:24:56.853823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:32:01.075020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1882,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.116118+0000","last_change":"2024-04-15T15:01:42.779951+0000","last_active":"2024-04-15T15:24:57.116118+0000","last_peered":"2024-04-15T15:24:57.116118+0000","last_clean":"2024-04-15T15:24:57.116118+0000","last_became_active":"2024-04-15T15:01:42.774408+0000","last_became_peered":"2024-04-15T15:01:42.774408+0000","last_unstale":"2024-04-15T15:24:57.116118+0000","last_undegraded":"2024-04-15T15:24:57.116118+0000","last_fullsized":"2024-04-15T15:24:57.116118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1888,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.843110+0000","last_change":"2024-04-15T15:01:58.212111+0000","last_active":"2024-04-15T15:24:56.843110+0000","last_peered":"2024-04-15T15:24:56.843110+0000","last_clean":"2024-04-15T15:24:56.843110+0000","last_became_active":"2024-04-15T15:01:58.202626+0000","last_became_peered":"2024-04-15T15:01:58.202626+0000","last_unstale":"2024-04-15T15:24:56.843110+0000","last_undegraded":"2024-04-15T15:24:56.843110+0000","last_fullsized":"2024-04-15T15:24:56.843110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:42:06.026358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1888,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.832288+0000","last_change":"2024-04-15T15:01:54.211646+0000","last_active":"2024-04-15T15:24:56.832288+0000","last_peered":"2024-04-15T15:24:56.832288+0000","last_clean":"2024-04-15T15:24:56.832288+0000","last_became_active":"2024-04-15T15:01:54.206258+0000","last_became_peered":"2024-04-15T15:01:54.206258+0000","last_unstale":"2024-04-15T15:24:56.832288+0000","last_undegraded":"2024-04-15T15:24:56.832288+0000","last_fullsized":"2024-04-15T15:24:56.832288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:10:44.038067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1903,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.047602+0000","last_change":"2024-04-15T15:01:43.288156+0000","last_active":"2024-04-15T15:24:57.047602+0000","last_peered":"2024-04-15T15:24:57.047602+0000","last_clean":"2024-04-15T15:24:57.047602+0000","last_became_active":"2024-04-15T15:01:43.261603+0000","last_became_peered":"2024-04-15T15:01:43.261603+0000","last_unstale":"2024-04-15T15:24:57.047602+0000","last_undegraded":"2024-04-15T15:24:57.047602+0000","last_fullsized":"2024-04-15T15:24:57.047602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:24:52.000881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1897,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.087289+0000","last_change":"2024-04-15T15:01:58.020146+0000","last_active":"2024-04-15T15:24:57.087289+0000","last_peered":"2024-04-15T15:24:57.087289+0000","last_clean":"2024-04-15T15:24:57.087289+0000","last_became_active":"2024-04-15T15:01:58.007306+0000","last_became_peered":"2024-04-15T15:01:58.007306+0000","last_unstale":"2024-04-15T15:24:57.087289+0000","last_undegraded":"2024-04-15T15:24:57.087289+0000","last_fullsized":"2024-04-15T15:24:57.087289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:51:31.200321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1887,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:56.820651+0000","last_change":"2024-04-15T15:01:53.764775+0000","last_active":"2024-04-15T15:24:56.820651+0000","last_peered":"2024-04-15T15:24:56.820651+0000","last_clean":"2024-04-15T15:24:56.820651+0000","last_became_active":"2024-04-15T15:01:53.747318+0000","last_became_peered":"2024-04-15T15:01:53.747318+0000","last_unstale":"2024-04-15T15:24:56.820651+0000","last_undegraded":"2024-04-15T15:24:56.820651+0000","last_fullsized":"2024-04-15T15:24:56.820651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:26:07.121772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":999,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:01.362255+0000","last_change":"2024-04-15T15:11:58.160174+0000","last_active":"2024-04-15T15:25:01.362255+0000","last_peered":"2024-04-15T15:25:01.362255+0000","last_clean":"2024-04-15T15:25:01.362255+0000","last_became_active":"2024-04-15T15:11:58.147973+0000","last_became_peered":"2024-04-15T15:11:58.147973+0000","last_unstale":"2024-04-15T15:25:01.362255+0000","last_undegraded":"2024-04-15T15:25:01.362255+0000","last_fullsized":"2024-04-15T15:25:01.362255+0000","mapping_epoch":488,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":489,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1887,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.112354+0000","last_change":"2024-04-15T15:01:50.350153+0000","last_active":"2024-04-15T15:24:57.112354+0000","last_peered":"2024-04-15T15:24:57.112354+0000","last_clean":"2024-04-15T15:24:57.112354+0000","last_became_active":"2024-04-15T15:01:50.337533+0000","last_became_peered":"2024-04-15T15:01:50.337533+0000","last_unstale":"2024-04-15T15:24:57.112354+0000","last_undegraded":"2024-04-15T15:24:57.112354+0000","last_fullsized":"2024-04-15T15:24:57.112354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:13:36.423971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1900,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:57.066271+0000","last_change":"2024-04-15T15:01:38.478868+0000","last_active":"2024-04-15T15:24:57.066271+0000","last_peered":"2024-04-15T15:24:57.066271+0000","last_clean":"2024-04-15T15:24:57.066271+0000","last_became_active":"2024-04-15T15:01:38.420878+0000","last_became_peered":"2024-04-15T15:01:38.420878+0000","last_unstale":"2024-04-15T15:24:57.066271+0000","last_undegraded":"2024-04-15T15:24:57.066271+0000","last_fullsized":"2024-04-15T15:24:57.066271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:01:21.084498+0000","last_clean_scrub_stamp":"2024-04-15T15:01:21.084498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:10.994698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1875,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:00.549105+0000","last_change":"2024-04-15T15:25:00.550496+0000","last_active":"2024-04-15T15:25:00.549105+0000","last_peered":"2024-04-15T15:25:00.549105+0000","last_clean":"2024-04-15T15:25:00.549105+0000","last_became_active":"2024-04-15T15:01:40.945764+0000","last_became_peered":"2024-04-15T15:01:40.945764+0000","last_unstale":"2024-04-15T15:25:00.549105+0000","last_undegraded":"2024-04-15T15:25:00.549105+0000","last_fullsized":"2024-04-15T15:25:00.549105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:00.546866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:00.546866+0000","last_clean_scrub_stamp":"2024-04-15T15:25:00.546866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:28:25.723613+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1876,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:59.448847+0000","last_change":"2024-04-15T15:24:59.449806+0000","last_active":"2024-04-15T15:24:59.448847+0000","last_peered":"2024-04-15T15:24:59.448847+0000","last_clean":"2024-04-15T15:24:59.448847+0000","last_became_active":"2024-04-15T15:01:37.967524+0000","last_became_peered":"2024-04-15T15:01:37.967524+0000","last_unstale":"2024-04-15T15:24:59.448847+0000","last_undegraded":"2024-04-15T15:24:59.448847+0000","last_fullsized":"2024-04-15T15:24:59.448847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:24:59.443074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:24:59.443074+0000","last_clean_scrub_stamp":"2024-04-15T15:24:59.443074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:13:50.879562+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":2,"up_from":24,"seq":103079215409,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82908,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288932,"statfs":{"total":96636764160,"available":96551866368,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784248113,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82908,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288932,"statfs":{"total":96636764160,"available":96551866368,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313524,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70428,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301412,"statfs":{"total":96636764160,"available":96564645888,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313521,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70816,"kb_used_data":7704,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301024,"statfs":{"total":96636764160,"available":96564248576,"internally_reserved":0,"allocated":7888896,"data_stored":3874917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":20,"seq":85899346225,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70424,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301416,"statfs":{"total":96636764160,"available":96564649984,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477041,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74984,"kb_used_data":7708,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296856,"statfs":{"total":96636764160,"available":96559980544,"internally_reserved":0,"allocated":7892992,"data_stored":3874922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477041,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87064,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94284776,"statfs":{"total":96636764160,"available":96547610624,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81656262},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575156,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74592,"kb_used_data":7316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94297248,"statfs":{"total":96636764160,"available":96560381952,"internally_reserved":0,"allocated":7491584,"data_stored":3477082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:25:05.563 INFO:tasks.ceph:pgid 16.0 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.563 INFO:tasks.ceph:pgid 16.1 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.563 INFO:tasks.ceph:pgid 16.2 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.563 INFO:tasks.ceph:pgid 16.3 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.563 INFO:tasks.ceph:pgid 16.1c last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.563 INFO:tasks.ceph:pgid 16.1d last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.563 INFO:tasks.ceph:pgid 16.1e last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.563 INFO:tasks.ceph:pgid 16.1f last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.563 INFO:tasks.ceph:pgid 16.18 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 16.19 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 16.1a last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 16.1b last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 16.11 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-15T14:59:51.350288+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=14, tm_min=59, tm_sec=51, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 16.12 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-15T14:59:51.350288+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=14, tm_min=59, tm_sec=51, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 16.13 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-15T14:59:51.350288+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=14, tm_min=59, tm_sec=51, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.564 INFO:tasks.ceph:pgid 16.10 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-15T14:59:51.350288+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=14, tm_min=59, tm_sec=51, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 16.16 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-15T14:59:51.350288+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=14, tm_min=59, tm_sec=51, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 16.17 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-15T14:59:51.350288+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=14, tm_min=59, tm_sec=51, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 16.14 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-15T14:59:51.350288+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=14, tm_min=59, tm_sec=51, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 16.15 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-15T14:59:51.350288+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=14, tm_min=59, tm_sec=51, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.565 INFO:tasks.ceph:pgid 16.7 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:pgid 16.6 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:pgid 16.5 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:pgid 16.4 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:pgid 16.b last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:pgid 16.a last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:pgid 16.9 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:pgid 16.8 last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:pgid 16.f last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:pgid 16.e last_scrub_stamp 2024-04-15T15:01:21.084498+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=1, tm_sec=21, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=15, tm_min=24, tm_sec=57, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T15:25:05.566 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-15T15:25:11.933 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:49.776 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:11.936 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:49.778 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:11.959 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:49.802 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:11.986 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:49.777 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:11.990 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:49.781 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:11.994 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:49.837 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:11.996 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:49.839 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.013 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:49.803 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.019 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:49.862 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.678 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:50.468 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.678 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:50.469 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.686 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:50.477 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.719 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:50.561 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.720 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:50.563 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.729 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:50.572 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.752 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:50.596 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.754 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:50.597 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:12.763 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:50.607 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:16.946 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:54.789 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:16.950 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:54.793 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:16.962 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:26:54.805 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:16.999 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:54.789 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:17.000 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:54.790 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:17.009 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:26:54.799 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:17.026 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:54.870 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:17.028 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:54.871 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:17.039 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:26:54.882 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:25.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T15:25:25.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.674+0000 7fea30288640 10 monclient: get_monmap_and_config 2024-04-15T15:25:25.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.674+0000 7fea30288640 10 monclient: build_initial_monmap 2024-04-15T15:25:25.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.674+0000 7fea30288640 10 monclient: monmap: 2024-04-15T15:25:25.675 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:25.675 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:25.675 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:25.674981+0000 2024-04-15T15:25:25.676 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:25.674981+0000 2024-04-15T15:25:25.676 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:25.676 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:25.676 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:25.676 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:25.676 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:25.676 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:25.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.674+0000 7fea30288640 1 Processor -- start 2024-04-15T15:25:25.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.674+0000 7fea30288640 1 -- start start 2024-04-15T15:25:25.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.674+0000 7fea30288640 10 monclient: init 2024-04-15T15:25:25.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:25.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 10 monclient: _add_conns ranks=[1,0,2] 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 10 monclient(hunting): picked mon.noname-c con 0x7fea280b57d0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 10 monclient(hunting): picked mon.noname-a con 0x7fea280b5bb0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 10 monclient(hunting): picked mon.noname-b con 0x7fea28140b30 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea28146e10 con 0x7fea280b5bb0 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea280aa840 con 0x7fea280b57d0 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea280aa460 con 0x7fea28140b30 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.675+0000 7fea30288640 10 monclient(hunting): authenticate will time out at 2985.946045s 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.676+0000 7fea2e825640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fea28140b30 0x7fea2814ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:37522/0 (socket says 172.21.15.38:37522) 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.676+0000 7fea2e825640 1 -- 172.21.15.38:0/3800822933 learned_addr learned my addr 172.21.15.38:0/3800822933 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:25.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.676+0000 7fea2d823640 1 --1- 172.21.15.38:0/3800822933 >> v1:172.21.15.38:6789/0 conn(0x7fea280b5bb0 0x7fea28140420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60328/0 (socket says 172.21.15.38:60328) 2024-04-15T15:25:25.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689699488 0 0) 0x7fea28146e10 con 0x7fea280b5bb0 2024-04-15T15:25:25.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 10 monclient(hunting): _negotiate 2024-04-15T15:25:25.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:25.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:25.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 10 monclient(hunting): my global_id is 33654 2024-04-15T15:25:25.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea10003520 con 0x7fea280b5bb0 2024-04-15T15:25:25.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655876817 0 0) 0x7fea280aa460 con 0x7fea28140b30 2024-04-15T15:25:25.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 10 monclient(hunting): _negotiate 2024-04-15T15:25:25.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:25.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:25.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 10 monclient(hunting): my global_id is 81122 2024-04-15T15:25:25.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.678+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea28146e10 con 0x7fea28140b30 2024-04-15T15:25:25.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.679+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701100692 0 0) 0x7fea280aa840 con 0x7fea280b57d0 2024-04-15T15:25:25.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.679+0000 7fea2d022640 10 monclient(hunting): _negotiate 2024-04-15T15:25:25.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.679+0000 7fea2d022640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:25.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.679+0000 7fea2d022640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:25.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.679+0000 7fea2d022640 10 monclient(hunting): my global_id is 32368 2024-04-15T15:25:25.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.679+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea280aa460 con 0x7fea280b57d0 2024-04-15T15:25:25.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2189782031 0 0) 0x7fea28146e10 con 0x7fea28140b30 2024-04-15T15:25:25.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 >> v1:172.21.15.164:6789/0 conn(0x7fea280b57d0 legacy=0x7fea28146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:25.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 >> v1:172.21.15.38:6789/0 conn(0x7fea280b5bb0 legacy=0x7fea28140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 10 monclient: _finish_hunting 0 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 1 monclient: found mon.noname-b 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.38:6790/0 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea280b2970 con 0x7fea28140b30 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 10 monclient: _finish_auth 0 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 10 monclient: _check_auth_tickets 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea30288640 5 monclient: authenticate success, global_id 81122 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea30288640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fea18001970 con 0x7fea28140b30 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea2d022640 10 monclient: dump: 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:25.684 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:25.685 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:25.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.682+0000 7fea30288640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 <== mon.2 v1:172.21.15.38:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea18001c00 con 0x7fea28140b30 2024-04-15T15:25:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea2d022640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea2d022640 1 -- 172.21.15.38:0/3800822933 <== mon.2 v1:172.21.15.38:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fea18002010 con 0x7fea28140b30 2024-04-15T15:25:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea30288640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea30288640 4 set_mon_vals no callback set 2024-04-15T15:25:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea2d022640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea2d022640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea2d022640 10 monclient: dump: 2024-04-15T15:25:25.686 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea30288640 10 monclient: shutdown 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea30288640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea30288640 1 -- 172.21.15.38:0/3800822933 >> v1:172.21.15.38:6790/0 conn(0x7fea28140b30 legacy=0x7fea2814ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea30288640 1 -- 172.21.15.38:0/3800822933 shutdown_connections 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea30288640 1 -- 172.21.15.38:0/3800822933 >> 172.21.15.38:0/3800822933 conn(0x7fea28067790 msgr2=0x7fea28067ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:25.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea30288640 1 -- 172.21.15.38:0/3800822933 shutdown_connections 2024-04-15T15:25:25.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.684+0000 7fea30288640 1 -- 172.21.15.38:0/3800822933 wait complete. 2024-04-15T15:25:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.685+0000 7fea30288640 10 monclient: build_initial_monmap 2024-04-15T15:25:25.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.685+0000 7fea30288640 10 monclient: monmap: 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.685+0000 7fea30288640 1 librados: starting msgr at 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.685+0000 7fea30288640 1 librados: starting objecter 2024-04-15T15:25:25.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.685+0000 7fea30288640 1 Processor -- start 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.685+0000 7fea30288640 1 -- start start 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.685+0000 7fea30288640 1 librados: setting wanted keys 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.685+0000 7fea30288640 1 librados: calling monclient init 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.685+0000 7fea30288640 10 monclient: init 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 10 monclient: _add_conns ranks=[0,1,2] 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 10 monclient(hunting): picked mon.noname-a con 0x7fea280b57d0 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 10 monclient(hunting): picked mon.noname-b con 0x7fea280b5bb0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 10 monclient(hunting): picked mon.noname-c con 0x7fea28140b30 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea28143bc0 con 0x7fea280b57d0 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea28143e30 con 0x7fea280b5bb0 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea280b08c0 con 0x7fea28140b30 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea30288640 10 monclient(hunting): authenticate will time out at 2985.956904s 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea2e825640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fea28140b30 0x7fea28139e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:37538/0 (socket says 172.21.15.38:37538) 2024-04-15T15:25:25.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea2e825640 1 -- 172.21.15.38:0/1302446552 learned_addr learned my addr 172.21.15.38:0/1302446552 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.686+0000 7fea2e024640 1 --1- 172.21.15.38:0/1302446552 >> v1:172.21.15.38:6789/0 conn(0x7fea280b57d0 0x7fea281428e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60332/0 (socket says 172.21.15.38:60332) 2024-04-15T15:25:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.687+0000 7fea26ffd640 10 client.?.objecter ms_handle_connect 0x7fea28140b30 2024-04-15T15:25:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.687+0000 7fea26ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.687+0000 7fea26ffd640 10 client.?.objecter ms_handle_connect 0x7fea280b57d0 2024-04-15T15:25:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.687+0000 7fea26ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.687+0000 7fea26ffd640 10 client.?.objecter ms_handle_connect 0x7fea280b5bb0 2024-04-15T15:25:25.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.687+0000 7fea26ffd640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:25.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626546034 0 0) 0x7fea280b08c0 con 0x7fea28140b30 2024-04-15T15:25:25.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): _negotiate 2024-04-15T15:25:25.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:25.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:25.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): my global_id is 81125 2024-04-15T15:25:25.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea14004eb0 con 0x7fea28140b30 2024-04-15T15:25:25.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708959275 0 0) 0x7fea28143bc0 con 0x7fea280b57d0 2024-04-15T15:25:25.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): _negotiate 2024-04-15T15:25:25.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:25.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:25.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): my global_id is 33657 2024-04-15T15:25:25.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea280b08c0 con 0x7fea280b57d0 2024-04-15T15:25:25.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562638486 0 0) 0x7fea10003520 con 0x7fea280b5bb0 2024-04-15T15:25:25.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): _negotiate 2024-04-15T15:25:25.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:25.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:25.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 10 monclient(hunting): my global_id is 32371 2024-04-15T15:25:25.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.689+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea28143bc0 con 0x7fea280b5bb0 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4067848277 0 0) 0x7fea14004eb0 con 0x7fea28140b30 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea10003520 con 0x7fea28140b30 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fea18001f50 con 0x7fea28140b30 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): dump: 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:25.696 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 903992898 0 0) 0x7fea280b08c0 con 0x7fea280b57d0 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea14004eb0 con 0x7fea280b57d0 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 826541247 0 0) 0x7fea28143bc0 con 0x7fea280b5bb0 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea280b08c0 con 0x7fea280b5bb0 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fea1c0018d0 con 0x7fea280b5bb0 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): dump: 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:25.697 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fea200018f0 con 0x7fea280b57d0 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.694+0000 7fea26ffd640 10 monclient(hunting): dump: 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.698 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:25.699 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:25.699 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:25.699 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:25.699 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:25.699 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3021108407 0 0) 0x7fea10003520 con 0x7fea28140b30 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 >> v1:172.21.15.164:6789/0 conn(0x7fea280b5bb0 legacy=0x7fea281d8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 >> v1:172.21.15.38:6789/0 conn(0x7fea280b57d0 legacy=0x7fea281428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 10 monclient: _finish_hunting 0 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 1 monclient: found mon.c 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea28141d20 con 0x7fea28140b30 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 10 monclient: _finish_auth 0 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 10 monclient: _check_auth_tickets 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea30288640 5 monclient: authenticate success, global_id 81125 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea30288640 10 monclient: _renew_subs 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea30288640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.696+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea28142010 con 0x7fea28140b30 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.697+0000 7fea30288640 10 client.81125.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.697+0000 7fea30288640 10 monclient: _renew_subs 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.697+0000 7fea30288640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.697+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fea281d8f10 con 0x7fea28140b30 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.697+0000 7fea30288640 1 librados: init done 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.697+0000 7fea30288640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.697+0000 7fea30288640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.697+0000 7fea30288640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:25.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.697+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea281430b0 con 0x7fea28140b30 2024-04-15T15:25:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.963+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea18001c00 con 0x7fea28140b30 2024-04-15T15:25:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.963+0000 7fea26ffd640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.963+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fea18004f60 con 0x7fea28140b30 2024-04-15T15:25:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.963+0000 7fea26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.963+0000 7fea26ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.963+0000 7fea26ffd640 10 monclient: dump: 2024-04-15T15:25:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:25.965 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:25.966 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.963+0000 7fea2c821640 4 set_mon_vals no callback set 2024-04-15T15:25:25.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.964+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fea1801b490 con 0x7fea28140b30 2024-04-15T15:25:25.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.965+0000 7fea2e024640 10 monclient: get_auth_request con 0x7fea1406eef0 auth_method 0 2024-04-15T15:25:25.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.965+0000 7fea26ffd640 10 client.81125.objecter ms_handle_connect 0x7fea1406eef0 2024-04-15T15:25:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.968+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(996..996 src has 804..996) ==== 5226+0+0 (unknown 3562918763 0 0) 0x7fea18053580 con 0x7fea28140b30 2024-04-15T15:25:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.968+0000 7fea26ffd640 10 client.81125.objecter ms_dispatch 0x7fea28000b90 osd_map(996..996 src has 804..996) 2024-04-15T15:25:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.968+0000 7fea26ffd640 3 client.81125.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.968+0000 7fea26ffd640 3 client.81125.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.968+0000 7fea26ffd640 20 client.81125.objecter dump_active .. 0 homeless 2024-04-15T15:25:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.968+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fea18055980 con 0x7fea28140b30 2024-04-15T15:25:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.968+0000 7fea26ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:25.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:25.968+0000 7fea26ffd640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:25:26.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.152+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 --> v1:172.21.15.38:6800/1608957829 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea28075f00 con 0x7fea1406eef0 2024-04-15T15:25:26.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.154+0000 7fea26ffd640 1 -- 172.21.15.38:0/1302446552 <== mgr.4110 v1:172.21.15.38:6800/1608957829 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+116160 (unknown 2965378022 0 2197596253) 0x7fea28075f00 con 0x7fea1406eef0 2024-04-15T15:25:26.157 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-15T15:25:26.158 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-15T15:25:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.156+0000 7fea30288640 10 librados: watch_flush enter 2024-04-15T15:25:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.156+0000 7fea30288640 10 librados: watch_flush exit 2024-04-15T15:25:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.156+0000 7fea30288640 20 client.81125.objecter shutdown clearing up homeless session... 2024-04-15T15:25:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.156+0000 7fea30288640 10 client.81125.objecter successfully canceled tick 2024-04-15T15:25:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.157+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 >> v1:172.21.15.38:6800/1608957829 conn(0x7fea1406eef0 legacy=0x7fea140713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:26.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.157+0000 7fea30288640 10 monclient: shutdown 2024-04-15T15:25:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.157+0000 7fea30288640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.157+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 >> v1:172.21.15.38:6790/0 conn(0x7fea28140b30 legacy=0x7fea28139e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.157+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 shutdown_connections 2024-04-15T15:25:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.157+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 >> 172.21.15.38:0/1302446552 conn(0x7fea28067790 msgr2=0x7fea28067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.157+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 shutdown_connections 2024-04-15T15:25:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.157+0000 7fea30288640 1 -- 172.21.15.38:0/1302446552 wait complete. 2024-04-15T15:25:26.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.157+0000 7fea30288640 1 librados: shutdown 2024-04-15T15:25:26.169 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":1774,"stamp":"2024-04-15T15:25:25.191138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":614104,"kb_used_data":59288,"kb_used_omap":12,"kb_used_meta":554739,"kb_avail":754360616,"statfs":{"total":773094113280,"available":772465270784,"internally_reserved":0,"allocated":60710912,"data_stored":28612306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":568053297},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002821"},"pg_stats":[{"pgid":"16.0","version":"0'0","reported_seq":1899,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:06.103972+0000","last_change":"2024-04-15T15:25:06.104776+0000","last_active":"2024-04-15T15:25:06.103972+0000","last_peered":"2024-04-15T15:25:06.103972+0000","last_clean":"2024-04-15T15:25:06.103972+0000","last_became_active":"2024-04-15T15:01:50.426257+0000","last_became_peered":"2024-04-15T15:01:50.426257+0000","last_unstale":"2024-04-15T15:25:06.103972+0000","last_undegraded":"2024-04-15T15:25:06.103972+0000","last_fullsized":"2024-04-15T15:25:06.103972+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:06.100025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:06.100025+0000","last_clean_scrub_stamp":"2024-04-15T15:25:06.100025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:37:12.914064+0000","scrub_duration":106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1","version":"996'8","reported_seq":1921,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:06.582602+0000","last_change":"2024-04-15T15:25:06.583902+0000","last_active":"2024-04-15T15:25:06.582602+0000","last_peered":"2024-04-15T15:25:06.582602+0000","last_clean":"2024-04-15T15:25:06.582602+0000","last_became_active":"2024-04-15T15:01:58.055451+0000","last_became_peered":"2024-04-15T15:01:58.055451+0000","last_unstale":"2024-04-15T15:25:06.582602+0000","last_undegraded":"2024-04-15T15:25:06.582602+0000","last_fullsized":"2024-04-15T15:25:06.582602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"996'8","last_scrub_stamp":"2024-04-15T15:25:06.581137+0000","last_deep_scrub":"996'8","last_deep_scrub_stamp":"2024-04-15T15:25:06.581137+0000","last_clean_scrub_stamp":"2024-04-15T15:25:06.581137+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:34:20.207143+0000","scrub_duration":117,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1866,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:01.442183+0000","last_change":"2024-04-15T15:25:01.443013+0000","last_active":"2024-04-15T15:25:01.442183+0000","last_peered":"2024-04-15T15:25:01.442183+0000","last_clean":"2024-04-15T15:25:01.442183+0000","last_became_active":"2024-04-15T15:01:50.831566+0000","last_became_peered":"2024-04-15T15:01:50.831566+0000","last_unstale":"2024-04-15T15:25:01.442183+0000","last_undegraded":"2024-04-15T15:25:01.442183+0000","last_fullsized":"2024-04-15T15:25:01.442183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:01.440530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:01.440530+0000","last_clean_scrub_stamp":"2024-04-15T15:25:01.440530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:31:35.372105+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1891,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:07.206841+0000","last_change":"2024-04-15T15:25:07.207649+0000","last_active":"2024-04-15T15:25:07.206841+0000","last_peered":"2024-04-15T15:25:07.206841+0000","last_clean":"2024-04-15T15:25:07.206841+0000","last_became_active":"2024-04-15T15:01:37.307442+0000","last_became_peered":"2024-04-15T15:01:37.307442+0000","last_unstale":"2024-04-15T15:25:07.206841+0000","last_undegraded":"2024-04-15T15:25:07.206841+0000","last_fullsized":"2024-04-15T15:25:07.206841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:07.205229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:07.205229+0000","last_clean_scrub_stamp":"2024-04-15T15:25:07.205229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:15:52.974122+0000","scrub_duration":73,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1895,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:09.023702+0000","last_change":"2024-04-15T15:25:09.024484+0000","last_active":"2024-04-15T15:25:09.023702+0000","last_peered":"2024-04-15T15:25:09.023702+0000","last_clean":"2024-04-15T15:25:09.023702+0000","last_became_active":"2024-04-15T15:01:59.386200+0000","last_became_peered":"2024-04-15T15:01:59.386200+0000","last_unstale":"2024-04-15T15:25:09.023702+0000","last_undegraded":"2024-04-15T15:25:09.023702+0000","last_fullsized":"2024-04-15T15:25:09.023702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:09.022119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:09.022119+0000","last_clean_scrub_stamp":"2024-04-15T15:25:09.022119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:50.345797+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1895,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:10.033766+0000","last_change":"2024-04-15T15:25:10.034537+0000","last_active":"2024-04-15T15:25:10.033766+0000","last_peered":"2024-04-15T15:25:10.033766+0000","last_clean":"2024-04-15T15:25:10.033766+0000","last_became_active":"2024-04-15T15:01:59.475519+0000","last_became_peered":"2024-04-15T15:01:59.475519+0000","last_unstale":"2024-04-15T15:25:10.033766+0000","last_undegraded":"2024-04-15T15:25:10.033766+0000","last_fullsized":"2024-04-15T15:25:10.033766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:10.032220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:10.032220+0000","last_clean_scrub_stamp":"2024-04-15T15:25:10.032220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:52:13.444339+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1883,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:01.893055+0000","last_change":"2024-04-15T15:25:01.893871+0000","last_active":"2024-04-15T15:25:01.893055+0000","last_peered":"2024-04-15T15:25:01.893055+0000","last_clean":"2024-04-15T15:25:01.893055+0000","last_became_active":"2024-04-15T15:02:06.539897+0000","last_became_peered":"2024-04-15T15:02:06.539897+0000","last_unstale":"2024-04-15T15:25:01.893055+0000","last_undegraded":"2024-04-15T15:25:01.893055+0000","last_fullsized":"2024-04-15T15:25:01.893055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:01.891520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:01.891520+0000","last_clean_scrub_stamp":"2024-04-15T15:25:01.891520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:32:20.193323+0000","scrub_duration":78,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1864,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:02.503115+0000","last_change":"2024-04-15T15:25:02.504307+0000","last_active":"2024-04-15T15:25:02.503115+0000","last_peered":"2024-04-15T15:25:02.503115+0000","last_clean":"2024-04-15T15:25:02.503115+0000","last_became_active":"2024-04-15T15:01:56.846541+0000","last_became_peered":"2024-04-15T15:01:56.846541+0000","last_unstale":"2024-04-15T15:25:02.503115+0000","last_undegraded":"2024-04-15T15:25:02.503115+0000","last_fullsized":"2024-04-15T15:25:02.503115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:02.497740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:02.497740+0000","last_clean_scrub_stamp":"2024-04-15T15:25:02.497740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:42:55.747760+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1912,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:06.079698+0000","last_change":"2024-04-15T15:25:06.080732+0000","last_active":"2024-04-15T15:25:06.079698+0000","last_peered":"2024-04-15T15:25:06.079698+0000","last_clean":"2024-04-15T15:25:06.079698+0000","last_became_active":"2024-04-15T15:01:31.025154+0000","last_became_peered":"2024-04-15T15:01:31.025154+0000","last_unstale":"2024-04-15T15:25:06.079698+0000","last_undegraded":"2024-04-15T15:25:06.079698+0000","last_fullsized":"2024-04-15T15:25:06.079698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:06.078054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:06.078054+0000","last_clean_scrub_stamp":"2024-04-15T15:25:06.078054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:49:33.175734+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1889,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:09.179228+0000","last_change":"2024-04-15T15:25:09.180062+0000","last_active":"2024-04-15T15:25:09.179228+0000","last_peered":"2024-04-15T15:25:09.179228+0000","last_clean":"2024-04-15T15:25:09.179228+0000","last_became_active":"2024-04-15T15:01:47.652436+0000","last_became_peered":"2024-04-15T15:01:47.652436+0000","last_unstale":"2024-04-15T15:25:09.179228+0000","last_undegraded":"2024-04-15T15:25:09.179228+0000","last_fullsized":"2024-04-15T15:25:09.179228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:09.177594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:09.177594+0000","last_clean_scrub_stamp":"2024-04-15T15:25:09.177594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T18:39:45.411089+0000","scrub_duration":62,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1905,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:07.485264+0000","last_change":"2024-04-15T15:25:07.486116+0000","last_active":"2024-04-15T15:25:07.485264+0000","last_peered":"2024-04-15T15:25:07.485264+0000","last_clean":"2024-04-15T15:25:07.485264+0000","last_became_active":"2024-04-15T15:01:58.198421+0000","last_became_peered":"2024-04-15T15:01:58.198421+0000","last_unstale":"2024-04-15T15:25:07.485264+0000","last_undegraded":"2024-04-15T15:25:07.485264+0000","last_fullsized":"2024-04-15T15:25:07.485264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:07.483341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:07.483341+0000","last_clean_scrub_stamp":"2024-04-15T15:25:07.483341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:00:14.662010+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1897,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:01.913401+0000","last_change":"2024-04-15T15:25:01.914227+0000","last_active":"2024-04-15T15:25:01.913401+0000","last_peered":"2024-04-15T15:25:01.913401+0000","last_clean":"2024-04-15T15:25:01.913401+0000","last_became_active":"2024-04-15T15:01:58.520219+0000","last_became_peered":"2024-04-15T15:01:58.520219+0000","last_unstale":"2024-04-15T15:25:01.913401+0000","last_undegraded":"2024-04-15T15:25:01.913401+0000","last_fullsized":"2024-04-15T15:25:01.913401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:01.911864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:01.911864+0000","last_clean_scrub_stamp":"2024-04-15T15:25:01.911864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:41:58.268886+0000","scrub_duration":81,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1888,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:00.833973+0000","last_change":"2024-04-15T15:25:00.834813+0000","last_active":"2024-04-15T15:25:00.833973+0000","last_peered":"2024-04-15T15:25:00.833973+0000","last_clean":"2024-04-15T15:25:00.833973+0000","last_became_active":"2024-04-15T15:01:48.927422+0000","last_became_peered":"2024-04-15T15:01:48.927422+0000","last_unstale":"2024-04-15T15:25:00.833973+0000","last_undegraded":"2024-04-15T15:25:00.833973+0000","last_fullsized":"2024-04-15T15:25:00.833973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:00.832317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:00.832317+0000","last_clean_scrub_stamp":"2024-04-15T15:25:00.832317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:24:55.829405+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"996'78","reported_seq":2045,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:59.955958+0000","last_change":"2024-04-15T15:24:59.957323+0000","last_active":"2024-04-15T15:24:59.955958+0000","last_peered":"2024-04-15T15:24:59.955958+0000","last_clean":"2024-04-15T15:24:59.955958+0000","last_became_active":"2024-04-15T14:59:44.414489+0000","last_became_peered":"2024-04-15T14:59:44.414489+0000","last_unstale":"2024-04-15T15:24:59.955958+0000","last_undegraded":"2024-04-15T15:24:59.955958+0000","last_fullsized":"2024-04-15T15:24:59.955958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"996'78","last_scrub_stamp":"2024-04-15T15:24:59.954244+0000","last_deep_scrub":"996'78","last_deep_scrub_stamp":"2024-04-15T15:24:59.954244+0000","last_clean_scrub_stamp":"2024-04-15T15:24:59.954244+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:42:20.898337+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1906,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:05.252628+0000","last_change":"2024-04-15T15:25:05.253438+0000","last_active":"2024-04-15T15:25:05.252628+0000","last_peered":"2024-04-15T15:25:05.252628+0000","last_clean":"2024-04-15T15:25:05.252628+0000","last_became_active":"2024-04-15T14:59:53.276305+0000","last_became_peered":"2024-04-15T14:59:53.276305+0000","last_unstale":"2024-04-15T15:25:05.252628+0000","last_undegraded":"2024-04-15T15:25:05.252628+0000","last_fullsized":"2024-04-15T15:25:05.252628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:05.251037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:05.251037+0000","last_clean_scrub_stamp":"2024-04-15T15:25:05.251037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:25:21.089894+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1900,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:00.871080+0000","last_change":"2024-04-15T15:25:00.872027+0000","last_active":"2024-04-15T15:25:00.871080+0000","last_peered":"2024-04-15T15:25:00.871080+0000","last_clean":"2024-04-15T15:25:00.871080+0000","last_became_active":"2024-04-15T15:01:50.052081+0000","last_became_peered":"2024-04-15T15:01:50.052081+0000","last_unstale":"2024-04-15T15:25:00.871080+0000","last_undegraded":"2024-04-15T15:25:00.871080+0000","last_fullsized":"2024-04-15T15:25:00.871080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:00.869287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:00.869287+0000","last_clean_scrub_stamp":"2024-04-15T15:25:00.869287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:31:21.703495+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1906,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:02.373270+0000","last_change":"2024-04-15T15:25:02.374645+0000","last_active":"2024-04-15T15:25:02.373270+0000","last_peered":"2024-04-15T15:25:02.373270+0000","last_clean":"2024-04-15T15:25:02.373270+0000","last_became_active":"2024-04-15T14:59:52.908707+0000","last_became_peered":"2024-04-15T14:59:52.908707+0000","last_unstale":"2024-04-15T15:25:02.373270+0000","last_undegraded":"2024-04-15T15:25:02.373270+0000","last_fullsized":"2024-04-15T15:25:02.373270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:02.368999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:02.368999+0000","last_clean_scrub_stamp":"2024-04-15T15:25:02.368999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:56:48.183542+0000","scrub_duration":101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1911,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:08.037286+0000","last_change":"2024-04-15T15:25:08.038138+0000","last_active":"2024-04-15T15:25:08.037286+0000","last_peered":"2024-04-15T15:25:08.037286+0000","last_clean":"2024-04-15T15:25:08.037286+0000","last_became_active":"2024-04-15T15:01:37.900280+0000","last_became_peered":"2024-04-15T15:01:37.900280+0000","last_unstale":"2024-04-15T15:25:08.037286+0000","last_undegraded":"2024-04-15T15:25:08.037286+0000","last_fullsized":"2024-04-15T15:25:08.037286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:08.035615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:08.035615+0000","last_clean_scrub_stamp":"2024-04-15T15:25:08.035615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:17:25.788630+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1924,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:05.076655+0000","last_change":"2024-04-15T15:25:05.077521+0000","last_active":"2024-04-15T15:25:05.076655+0000","last_peered":"2024-04-15T15:25:05.076655+0000","last_clean":"2024-04-15T15:25:05.076655+0000","last_became_active":"2024-04-15T14:59:52.828831+0000","last_became_peered":"2024-04-15T14:59:52.828831+0000","last_unstale":"2024-04-15T15:25:05.076655+0000","last_undegraded":"2024-04-15T15:25:05.076655+0000","last_fullsized":"2024-04-15T15:25:05.076655+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:05.071539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:05.071539+0000","last_clean_scrub_stamp":"2024-04-15T15:25:05.071539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:38:13.982230+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1906,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:04.424703+0000","last_change":"2024-04-15T15:25:04.425522+0000","last_active":"2024-04-15T15:25:04.424703+0000","last_peered":"2024-04-15T15:25:04.424703+0000","last_clean":"2024-04-15T15:25:04.424703+0000","last_became_active":"2024-04-15T15:01:57.822039+0000","last_became_peered":"2024-04-15T15:01:57.822039+0000","last_unstale":"2024-04-15T15:25:04.424703+0000","last_undegraded":"2024-04-15T15:25:04.424703+0000","last_fullsized":"2024-04-15T15:25:04.424703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:04.421811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:04.421811+0000","last_clean_scrub_stamp":"2024-04-15T15:25:04.421811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:19:32.744811+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1906,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:04.235394+0000","last_change":"2024-04-15T15:25:04.236220+0000","last_active":"2024-04-15T15:25:04.235394+0000","last_peered":"2024-04-15T15:25:04.235394+0000","last_clean":"2024-04-15T15:25:04.235394+0000","last_became_active":"2024-04-15T14:59:53.217062+0000","last_became_peered":"2024-04-15T14:59:53.217062+0000","last_unstale":"2024-04-15T15:25:04.235394+0000","last_undegraded":"2024-04-15T15:25:04.235394+0000","last_fullsized":"2024-04-15T15:25:04.235394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:04.233715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:04.233715+0000","last_clean_scrub_stamp":"2024-04-15T15:25:04.233715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:15:06.717034+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1909,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:10.939075+0000","last_change":"2024-04-15T15:25:10.939871+0000","last_active":"2024-04-15T15:25:10.939075+0000","last_peered":"2024-04-15T15:25:10.939075+0000","last_clean":"2024-04-15T15:25:10.939075+0000","last_became_active":"2024-04-15T15:01:44.538256+0000","last_became_peered":"2024-04-15T15:01:44.538256+0000","last_unstale":"2024-04-15T15:25:10.939075+0000","last_undegraded":"2024-04-15T15:25:10.939075+0000","last_fullsized":"2024-04-15T15:25:10.939075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:10.937478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:10.937478+0000","last_clean_scrub_stamp":"2024-04-15T15:25:10.937478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:23:42.661644+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1911,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:03.982994+0000","last_change":"2024-04-15T15:25:03.982994+0000","last_active":"2024-04-15T15:25:03.982994+0000","last_peered":"2024-04-15T15:25:03.982994+0000","last_clean":"2024-04-15T15:25:03.982994+0000","last_became_active":"2024-04-15T14:59:53.236225+0000","last_became_peered":"2024-04-15T14:59:53.236225+0000","last_unstale":"2024-04-15T15:25:03.982994+0000","last_undegraded":"2024-04-15T15:25:03.982994+0000","last_fullsized":"2024-04-15T15:25:03.982994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:03.980271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:03.980271+0000","last_clean_scrub_stamp":"2024-04-15T15:25:03.980271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:02:30.679796+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1894,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:11.090231+0000","last_change":"2024-04-15T15:25:11.091035+0000","last_active":"2024-04-15T15:25:11.090231+0000","last_peered":"2024-04-15T15:25:11.090231+0000","last_clean":"2024-04-15T15:25:11.090231+0000","last_became_active":"2024-04-15T15:01:59.575852+0000","last_became_peered":"2024-04-15T15:01:59.575852+0000","last_unstale":"2024-04-15T15:25:11.090231+0000","last_undegraded":"2024-04-15T15:25:11.090231+0000","last_fullsized":"2024-04-15T15:25:11.090231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:11.088707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:11.088707+0000","last_clean_scrub_stamp":"2024-04-15T15:25:11.088707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T20:32:04.438227+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1906,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:03.268424+0000","last_change":"2024-04-15T15:25:03.268424+0000","last_active":"2024-04-15T15:25:03.268424+0000","last_peered":"2024-04-15T15:25:03.268424+0000","last_clean":"2024-04-15T15:25:03.268424+0000","last_became_active":"2024-04-15T14:59:53.001226+0000","last_became_peered":"2024-04-15T14:59:53.001226+0000","last_unstale":"2024-04-15T15:25:03.268424+0000","last_undegraded":"2024-04-15T15:25:03.268424+0000","last_fullsized":"2024-04-15T15:25:03.268424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:03.263476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:03.263476+0000","last_clean_scrub_stamp":"2024-04-15T15:25:03.263476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T15:27:09.100432+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1896,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:05.120000+0000","last_change":"2024-04-15T15:25:05.120799+0000","last_active":"2024-04-15T15:25:05.120000+0000","last_peered":"2024-04-15T15:25:05.120000+0000","last_clean":"2024-04-15T15:25:05.120000+0000","last_became_active":"2024-04-15T15:01:53.660325+0000","last_became_peered":"2024-04-15T15:01:53.660325+0000","last_unstale":"2024-04-15T15:25:05.120000+0000","last_undegraded":"2024-04-15T15:25:05.120000+0000","last_fullsized":"2024-04-15T15:25:05.120000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:05.118415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:05.118415+0000","last_clean_scrub_stamp":"2024-04-15T15:25:05.118415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:06:20.952676+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1920,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:03.055253+0000","last_change":"2024-04-15T15:25:03.056090+0000","last_active":"2024-04-15T15:25:03.055253+0000","last_peered":"2024-04-15T15:25:03.055253+0000","last_clean":"2024-04-15T15:25:03.055253+0000","last_became_active":"2024-04-15T14:59:53.319031+0000","last_became_peered":"2024-04-15T14:59:53.319031+0000","last_unstale":"2024-04-15T15:25:03.055253+0000","last_undegraded":"2024-04-15T15:25:03.055253+0000","last_fullsized":"2024-04-15T15:25:03.055253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:03.052918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:03.052918+0000","last_clean_scrub_stamp":"2024-04-15T15:25:03.052918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:59:22.722955+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1911,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:07.029344+0000","last_change":"2024-04-15T15:25:07.030122+0000","last_active":"2024-04-15T15:25:07.029344+0000","last_peered":"2024-04-15T15:25:07.029344+0000","last_clean":"2024-04-15T15:25:07.029344+0000","last_became_active":"2024-04-15T15:01:36.581212+0000","last_became_peered":"2024-04-15T15:01:36.581212+0000","last_unstale":"2024-04-15T15:25:07.029344+0000","last_undegraded":"2024-04-15T15:25:07.029344+0000","last_fullsized":"2024-04-15T15:25:07.029344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:07.027805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:07.027805+0000","last_clean_scrub_stamp":"2024-04-15T15:25:07.027805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T21:52:34.195365+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1903,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:06.214884+0000","last_change":"2024-04-15T15:25:06.215678+0000","last_active":"2024-04-15T15:25:06.214884+0000","last_peered":"2024-04-15T15:25:06.214884+0000","last_clean":"2024-04-15T15:25:06.214884+0000","last_became_active":"2024-04-15T14:59:53.310268+0000","last_became_peered":"2024-04-15T14:59:53.310268+0000","last_unstale":"2024-04-15T15:25:06.214884+0000","last_undegraded":"2024-04-15T15:25:06.214884+0000","last_fullsized":"2024-04-15T15:25:06.214884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:06.213317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:06.213317+0000","last_clean_scrub_stamp":"2024-04-15T15:25:06.213317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:14:06.847109+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1896,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:04.130437+0000","last_change":"2024-04-15T15:25:04.130437+0000","last_active":"2024-04-15T15:25:04.130437+0000","last_peered":"2024-04-15T15:25:04.130437+0000","last_clean":"2024-04-15T15:25:04.130437+0000","last_became_active":"2024-04-15T15:01:53.609717+0000","last_became_peered":"2024-04-15T15:01:53.609717+0000","last_unstale":"2024-04-15T15:25:04.130437+0000","last_undegraded":"2024-04-15T15:25:04.130437+0000","last_fullsized":"2024-04-15T15:25:04.130437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:04.128174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:04.128174+0000","last_clean_scrub_stamp":"2024-04-15T15:25:04.128174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:17:36.398600+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1891,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:08.199680+0000","last_change":"2024-04-15T15:25:08.199680+0000","last_active":"2024-04-15T15:25:08.199680+0000","last_peered":"2024-04-15T15:25:08.199680+0000","last_clean":"2024-04-15T15:25:08.199680+0000","last_became_active":"2024-04-15T15:01:42.774408+0000","last_became_peered":"2024-04-15T15:01:42.774408+0000","last_unstale":"2024-04-15T15:25:08.199680+0000","last_undegraded":"2024-04-15T15:25:08.199680+0000","last_fullsized":"2024-04-15T15:25:08.199680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:08.197242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:08.197242+0000","last_clean_scrub_stamp":"2024-04-15T15:25:08.197242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T19:45:06.640786+0000","scrub_duration":74,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1897,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:08.074117+0000","last_change":"2024-04-15T15:25:08.074892+0000","last_active":"2024-04-15T15:25:08.074117+0000","last_peered":"2024-04-15T15:25:08.074117+0000","last_clean":"2024-04-15T15:25:08.074117+0000","last_became_active":"2024-04-15T15:01:58.202626+0000","last_became_peered":"2024-04-15T15:01:58.202626+0000","last_unstale":"2024-04-15T15:25:08.074117+0000","last_undegraded":"2024-04-15T15:25:08.074117+0000","last_fullsized":"2024-04-15T15:25:08.074117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:08.072588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:08.072588+0000","last_clean_scrub_stamp":"2024-04-15T15:25:08.072588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:51:50.360175+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1897,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:07.109712+0000","last_change":"2024-04-15T15:25:07.110624+0000","last_active":"2024-04-15T15:25:07.109712+0000","last_peered":"2024-04-15T15:25:07.109712+0000","last_clean":"2024-04-15T15:25:07.109712+0000","last_became_active":"2024-04-15T15:01:54.206258+0000","last_became_peered":"2024-04-15T15:01:54.206258+0000","last_unstale":"2024-04-15T15:25:07.109712+0000","last_undegraded":"2024-04-15T15:25:07.109712+0000","last_fullsized":"2024-04-15T15:25:07.109712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:07.105910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:07.105910+0000","last_clean_scrub_stamp":"2024-04-15T15:25:07.105910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:05:42.771002+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1912,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:10.035122+0000","last_change":"2024-04-15T15:25:10.035906+0000","last_active":"2024-04-15T15:25:10.035122+0000","last_peered":"2024-04-15T15:25:10.035122+0000","last_clean":"2024-04-15T15:25:10.035122+0000","last_became_active":"2024-04-15T15:01:43.261603+0000","last_became_peered":"2024-04-15T15:01:43.261603+0000","last_unstale":"2024-04-15T15:25:10.035122+0000","last_undegraded":"2024-04-15T15:25:10.035122+0000","last_fullsized":"2024-04-15T15:25:10.035122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:10.033573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:10.033573+0000","last_clean_scrub_stamp":"2024-04-15T15:25:10.033573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:49:02.674540+0000","scrub_duration":78,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1907,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:05.458749+0000","last_change":"2024-04-15T15:25:05.458749+0000","last_active":"2024-04-15T15:25:05.458749+0000","last_peered":"2024-04-15T15:25:05.458749+0000","last_clean":"2024-04-15T15:25:05.458749+0000","last_became_active":"2024-04-15T15:01:58.007306+0000","last_became_peered":"2024-04-15T15:01:58.007306+0000","last_unstale":"2024-04-15T15:25:05.458749+0000","last_undegraded":"2024-04-15T15:25:05.458749+0000","last_fullsized":"2024-04-15T15:25:05.458749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:05.456479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:05.456479+0000","last_clean_scrub_stamp":"2024-04-15T15:25:05.456479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T22:02:20.296832+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1897,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:06.123041+0000","last_change":"2024-04-15T15:25:06.123840+0000","last_active":"2024-04-15T15:25:06.123041+0000","last_peered":"2024-04-15T15:25:06.123041+0000","last_clean":"2024-04-15T15:25:06.123041+0000","last_became_active":"2024-04-15T15:01:53.747318+0000","last_became_peered":"2024-04-15T15:01:53.747318+0000","last_unstale":"2024-04-15T15:25:06.123041+0000","last_undegraded":"2024-04-15T15:25:06.123041+0000","last_fullsized":"2024-04-15T15:25:06.123041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:06.121435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:06.121435+0000","last_clean_scrub_stamp":"2024-04-15T15:25:06.121435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:44:54.983099+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1007,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:10.188314+0000","last_change":"2024-04-15T15:25:10.189125+0000","last_active":"2024-04-15T15:25:10.188314+0000","last_peered":"2024-04-15T15:25:10.188314+0000","last_clean":"2024-04-15T15:25:10.188314+0000","last_became_active":"2024-04-15T15:11:58.147973+0000","last_became_peered":"2024-04-15T15:11:58.147973+0000","last_unstale":"2024-04-15T15:25:10.188314+0000","last_undegraded":"2024-04-15T15:25:10.188314+0000","last_fullsized":"2024-04-15T15:25:10.188314+0000","mapping_epoch":488,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":489,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:10.186712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:10.186712+0000","last_clean_scrub_stamp":"2024-04-15T15:25:10.186712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T17:57:13.173463+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1896,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:05.095160+0000","last_change":"2024-04-15T15:25:05.095963+0000","last_active":"2024-04-15T15:25:05.095160+0000","last_peered":"2024-04-15T15:25:05.095160+0000","last_clean":"2024-04-15T15:25:05.095160+0000","last_became_active":"2024-04-15T15:01:50.337533+0000","last_became_peered":"2024-04-15T15:01:50.337533+0000","last_unstale":"2024-04-15T15:25:05.095160+0000","last_undegraded":"2024-04-15T15:25:05.095160+0000","last_fullsized":"2024-04-15T15:25:05.095160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:05.093578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:05.093578+0000","last_clean_scrub_stamp":"2024-04-15T15:25:05.093578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:50:20.107674+0000","scrub_duration":133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1909,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:09.025558+0000","last_change":"2024-04-15T15:25:09.026392+0000","last_active":"2024-04-15T15:25:09.025558+0000","last_peered":"2024-04-15T15:25:09.025558+0000","last_clean":"2024-04-15T15:25:09.025558+0000","last_became_active":"2024-04-15T15:01:38.420878+0000","last_became_peered":"2024-04-15T15:01:38.420878+0000","last_unstale":"2024-04-15T15:25:09.025558+0000","last_undegraded":"2024-04-15T15:25:09.025558+0000","last_fullsized":"2024-04-15T15:25:09.025558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:09.023953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:09.023953+0000","last_clean_scrub_stamp":"2024-04-15T15:25:09.023953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:31:25.139079+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1875,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:25:00.549105+0000","last_change":"2024-04-15T15:25:00.550496+0000","last_active":"2024-04-15T15:25:00.549105+0000","last_peered":"2024-04-15T15:25:00.549105+0000","last_clean":"2024-04-15T15:25:00.549105+0000","last_became_active":"2024-04-15T15:01:40.945764+0000","last_became_peered":"2024-04-15T15:01:40.945764+0000","last_unstale":"2024-04-15T15:25:00.549105+0000","last_undegraded":"2024-04-15T15:25:00.549105+0000","last_fullsized":"2024-04-15T15:25:00.549105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:25:00.546866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:25:00.546866+0000","last_clean_scrub_stamp":"2024-04-15T15:25:00.546866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T16:28:25.723613+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1876,"reported_epoch":996,"state":"active+clean","last_fresh":"2024-04-15T15:24:59.448847+0000","last_change":"2024-04-15T15:24:59.449806+0000","last_active":"2024-04-15T15:24:59.448847+0000","last_peered":"2024-04-15T15:24:59.448847+0000","last_clean":"2024-04-15T15:24:59.448847+0000","last_became_active":"2024-04-15T15:01:37.967524+0000","last_became_peered":"2024-04-15T15:01:37.967524+0000","last_unstale":"2024-04-15T15:24:59.448847+0000","last_undegraded":"2024-04-15T15:24:59.448847+0000","last_fullsized":"2024-04-15T15:24:59.448847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T15:24:59.443074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T15:24:59.443074+0000","last_clean_scrub_stamp":"2024-04-15T15:24:59.443074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:13:50.879562+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":2,"up_from":24,"seq":103079215413,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82904,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288936,"statfs":{"total":96636764160,"available":96551870464,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784248117,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82904,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94288936,"statfs":{"total":96636764160,"available":96551870464,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313528,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70424,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301416,"statfs":{"total":96636764160,"available":96564649984,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64616906},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313525,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70816,"kb_used_data":7704,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301024,"statfs":{"total":96636764160,"available":96564248576,"internally_reserved":0,"allocated":7888896,"data_stored":3874917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":20,"seq":85899346229,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70424,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94301416,"statfs":{"total":96636764160,"available":96564649984,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719477045,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74980,"kb_used_data":7708,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296860,"statfs":{"total":96636764160,"available":96559984640,"internally_reserved":0,"allocated":7892992,"data_stored":3874922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477045,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87064,"kb_used_data":7312,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94284776,"statfs":{"total":96636764160,"available":96547610624,"internally_reserved":0,"allocated":7487488,"data_stored":3477077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":81656262},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575160,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74588,"kb_used_data":7316,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94297252,"statfs":{"total":96636764160,"available":96560386048,"internally_reserved":0,"allocated":7491584,"data_stored":3477082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T15:25:26.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.273+0000 7fb1595f6640 10 monclient: get_monmap_and_config 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.273+0000 7fb1595f6640 10 monclient: build_initial_monmap 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.273+0000 7fb1595f6640 10 monclient: monmap: 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T15:25:26.274504+0000 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T15:25:26.274504+0000 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-c 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-b 2024-04-15T15:25:26.275 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:26.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.274+0000 7fb1595f6640 1 Processor -- start 2024-04-15T15:25:26.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.274+0000 7fb1595f6640 1 -- start start 2024-04-15T15:25:26.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.274+0000 7fb1595f6640 10 monclient: init 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.274+0000 7fb1595f6640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.274+0000 7fb1595f6640 10 monclient: _add_conns ranks=[0,2,1] 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.274+0000 7fb1595f6640 10 monclient(hunting): picked mon.noname-a con 0x7fb15406bf90 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb1595f6640 10 monclient(hunting): picked mon.noname-b con 0x7fb1540b1d00 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb1595f6640 10 monclient(hunting): picked mon.noname-c con 0x7fb1541474b0 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb1595f6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1540ae910 con 0x7fb15406bf90 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb1595f6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1540aebf0 con 0x7fb1541474b0 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb1595f6640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1540aeed0 con 0x7fb1540b1d00 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb1595f6640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb1595f6640 10 monclient(hunting): authenticate will time out at 2986.545460s 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb152ffd640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb15406bf90 0x7fb1540b15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60340/0 (socket says 172.21.15.38:60340) 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb14a7fc640 1 --1- >> v1:172.21.15.38:6790/0 conn(0x7fb1540b1d00 0x7fb154146da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6790/0 says I am v1:172.21.15.38:37542/0 (socket says 172.21.15.38:37542) 2024-04-15T15:25:26.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.275+0000 7fb152ffd640 1 -- 172.21.15.38:0/1949205574 learned_addr learned my addr 172.21.15.38:0/1949205574 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947888688 0 0) 0x7fb1540ae910 con 0x7fb15406bf90 2024-04-15T15:25:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): my global_id is 33660 2024-04-15T15:25:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb140003520 con 0x7fb15406bf90 2024-04-15T15:25:26.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 519750276 0 0) 0x7fb1540aeed0 con 0x7fb1540b1d00 2024-04-15T15:25:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): my global_id is 81128 2024-04-15T15:25:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1540ae910 con 0x7fb1540b1d00 2024-04-15T15:25:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3513125059 0 0) 0x7fb1540aebf0 con 0x7fb1541474b0 2024-04-15T15:25:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): _negotiate 2024-04-15T15:25:26.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:26.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:26.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 10 monclient(hunting): my global_id is 32374 2024-04-15T15:25:26.281 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.278+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1540aeed0 con 0x7fb1541474b0 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1343372698 0 0) 0x7fb140003520 con 0x7fb15406bf90 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 >> v1:172.21.15.38:6790/0 conn(0x7fb1540b1d00 legacy=0x7fb154146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 >> v1:172.21.15.164:6789/0 conn(0x7fb1541474b0 legacy=0x7fb15414ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 10 monclient: _finish_hunting 0 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 1 monclient: found mon.noname-a 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.38:6789/0 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1540af1b0 con 0x7fb15406bf90 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 10 monclient: _finish_auth 0 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 10 monclient: _check_auth_tickets 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb144001610 con 0x7fb15406bf90 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:26.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1527fc640 10 monclient: dump: 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1595f6640 5 monclient: authenticate success, global_id 33660 2024-04-15T15:25:26.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.281+0000 7fb1595f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-15T15:25:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.282+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 <== mon.0 v1:172.21.15.38:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb144001870 con 0x7fb15406bf90 2024-04-15T15:25:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.282+0000 7fb1527fc640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.282+0000 7fb1595f6640 10 monclient: get_monmap_and_config success 2024-04-15T15:25:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.282+0000 7fb1595f6640 4 set_mon_vals no callback set 2024-04-15T15:25:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1527fc640 1 -- 172.21.15.38:0/1949205574 <== mon.0 v1:172.21.15.38:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb144001bc0 con 0x7fb15406bf90 2024-04-15T15:25:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:26.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1527fc640 10 monclient: dump: 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1595f6640 10 monclient: shutdown 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1595f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1595f6640 1 -- 172.21.15.38:0/1949205574 >> v1:172.21.15.38:6789/0 conn(0x7fb15406bf90 legacy=0x7fb1540b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1595f6640 1 -- 172.21.15.38:0/1949205574 shutdown_connections 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1595f6640 1 -- 172.21.15.38:0/1949205574 >> 172.21.15.38:0/1949205574 conn(0x7fb1540b6bf0 msgr2=0x7fb1540b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1595f6640 1 -- 172.21.15.38:0/1949205574 shutdown_connections 2024-04-15T15:25:26.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.283+0000 7fb1595f6640 1 -- 172.21.15.38:0/1949205574 wait complete. 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.284+0000 7fb1595f6640 10 monclient: build_initial_monmap 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.284+0000 7fb1595f6640 10 monclient: monmap: 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 0 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 0.000000 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:created 0.000000 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 0 (unknown) 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 1 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.noname-a 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.noname-b 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.noname-c 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.284+0000 7fb1595f6640 1 librados: starting msgr at 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.284+0000 7fb1595f6640 1 librados: starting objecter 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.284+0000 7fb1595f6640 1 Processor -- start 2024-04-15T15:25:26.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 1 -- start start 2024-04-15T15:25:26.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 1 librados: setting wanted keys 2024-04-15T15:25:26.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 1 librados: calling monclient init 2024-04-15T15:25:26.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 10 monclient: init 2024-04-15T15:25:26.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 10 monclient: _reopen_session rank -1 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 10 monclient: _add_conns ranks=[1,2,0] 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 10 monclient(hunting): picked mon.noname-b con 0x7fb15406bf90 addr v1:172.21.15.164:6789/0 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 10 monclient(hunting): picked mon.noname-c con 0x7fb1541474b0 addr v1:172.21.15.38:6790/0 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 10 monclient(hunting): picked mon.noname-a con 0x7fb154142620 addr v1:172.21.15.38:6789/0 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb154124c00 con 0x7fb154142620 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb154122810 con 0x7fb15406bf90 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 1 -- --> v1:172.21.15.38:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb154142140 con 0x7fb1541474b0 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 10 monclient(hunting): _renew_subs 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.285+0000 7fb1595f6640 10 monclient(hunting): authenticate will time out at 2986.556119s 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.286+0000 7fb1537fe640 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb154142620 0x7fb1541d83a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60346/0 (socket says 172.21.15.38:60346) 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.286+0000 7fb1537fe640 1 -- 172.21.15.38:0/3220814700 learned_addr learned my addr 172.21.15.38:0/3220814700 (peer_addr_for_me v1:172.21.15.38:0/0) 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.286+0000 7fb14bfff640 10 client.?.objecter ms_handle_connect 0x7fb154142620 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.286+0000 7fb14bfff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:26.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.286+0000 7fb14bfff640 10 client.?.objecter ms_handle_connect 0x7fb1541474b0 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.286+0000 7fb14bfff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.286+0000 7fb14bfff640 10 client.?.objecter ms_handle_connect 0x7fb15406bf90 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.286+0000 7fb14bfff640 10 client.?.objecter resend_mon_ops 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189451442 0 0) 0x7fb154142140 con 0x7fb1541474b0 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): my global_id is 81131 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.38:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb134004eb0 con 0x7fb1541474b0 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549514622 0 0) 0x7fb154124c00 con 0x7fb154142620 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): my global_id is 33663 2024-04-15T15:25:26.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb154142140 con 0x7fb154142620 2024-04-15T15:25:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168984915 0 0) 0x7fb154122810 con 0x7fb15406bf90 2024-04-15T15:25:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): _negotiate 2024-04-15T15:25:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): _init_auth method 2 2024-04-15T15:25:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-15T15:25:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 10 monclient(hunting): my global_id is 32377 2024-04-15T15:25:26.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.288+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb154124c00 con 0x7fb15406bf90 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4186617296 0 0) 0x7fb134004eb0 con 0x7fb1541474b0 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.38:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb154122810 con 0x7fb1541474b0 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb13c001820 con 0x7fb1541474b0 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): dump: 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:26.295 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): _finish_auth 0 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 383829836 0 0) 0x7fb154142140 con 0x7fb154142620 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.38:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb134004eb0 con 0x7fb154142620 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb14c001c70 con 0x7fb154142620 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): dump: 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.296 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2038786436 0 0) 0x7fb154124c00 con 0x7fb15406bf90 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.164:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb154142140 con 0x7fb15406bf90 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb144001510 con 0x7fb15406bf90 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.293+0000 7fb14bfff640 10 monclient(hunting): dump: 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:26.297 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:26.298 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:26.298 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:26.298 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:26.298 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2113546624 0 0) 0x7fb154122810 con 0x7fb1541474b0 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 >> v1:172.21.15.164:6789/0 conn(0x7fb15406bf90 legacy=0x7fb154123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 >> v1:172.21.15.38:6789/0 conn(0x7fb154142620 legacy=0x7fb1541d83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 10 monclient: _finish_hunting 0 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 1 monclient: found mon.c 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.38:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb154142310 con 0x7fb1541474b0 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 10 monclient: _finish_auth 0 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 10 monclient: _check_auth_tickets 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb14bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-15T15:25:26.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb1595f6640 5 monclient: authenticate success, global_id 81131 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb1595f6640 10 monclient: _renew_subs 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb1595f6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.38:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb1541d8ab0 con 0x7fb1541474b0 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb1595f6640 10 client.81131.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb1595f6640 10 monclient: _renew_subs 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb1595f6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.38:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb1541d8f20 con 0x7fb1541474b0 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.296+0000 7fb1595f6640 1 librados: init done 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.297+0000 7fb1595f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.297+0000 7fb1595f6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.297+0000 7fb1595f6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:26.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.297+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.38:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb154077050 con 0x7fb1541474b0 2024-04-15T15:25:26.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.566+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb13c0047e0 con 0x7fb1541474b0 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.566+0000 7fb14bfff640 10 monclient: handle_config config(0 keys) 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.566+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3216450825 0 0) 0x7fb13c004b30 con 0x7fb1541474b0 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.566+0000 7fb14bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.566+0000 7fb14bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.566+0000 7fb14bfff640 10 monclient: dump: 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:epoch 1 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:fsid faa113cf-e8b3-4b6c-9186-1faf4aadaf02 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:last_changed 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:created 2024-04-15T14:57:45.641516+0000 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:min_mon_release 19 (squid) 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:election_strategy: 3 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:0: v1:172.21.15.38:6789/0 mon.a 2024-04-15T15:25:26.568 INFO:teuthology.orchestra.run.smithi038.stderr:1: v1:172.21.15.164:6789/0 mon.b 2024-04-15T15:25:26.569 INFO:teuthology.orchestra.run.smithi038.stderr:2: v1:172.21.15.38:6790/0 mon.c 2024-04-15T15:25:26.569 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:25:26.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.566+0000 7fb151ffb640 4 set_mon_vals no callback set 2024-04-15T15:25:26.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.567+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 7 ==== mgrmap(e 5) ==== 91005+0+0 (unknown 2207283187 0 0) 0x7fb13c01b060 con 0x7fb1541474b0 2024-04-15T15:25:26.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.567+0000 7fb152ffd640 10 monclient: get_auth_request con 0x7fb13406efe0 auth_method 0 2024-04-15T15:25:26.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.568+0000 7fb14bfff640 10 client.81131.objecter ms_handle_connect 0x7fb13406efe0 2024-04-15T15:25:26.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.573+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 8 ==== osd_map(996..996 src has 804..996) ==== 5226+0+0 (unknown 3562918763 0 0) 0x7fb13c053230 con 0x7fb1541474b0 2024-04-15T15:25:26.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.573+0000 7fb14bfff640 10 client.81131.objecter ms_dispatch 0x7fb154000b90 osd_map(996..996 src has 804..996) 2024-04-15T15:25:26.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.573+0000 7fb14bfff640 3 client.81131.objecter handle_osd_map got epochs [996,996] > 0 2024-04-15T15:25:26.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.573+0000 7fb14bfff640 3 client.81131.objecter handle_osd_map decoding full epoch 996 2024-04-15T15:25:26.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.573+0000 7fb14bfff640 20 client.81131.objecter dump_active .. 0 homeless 2024-04-15T15:25:26.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.573+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (unknown 1092875540 0 3221657173) 0x7fb13c055630 con 0x7fb1541474b0 2024-04-15T15:25:26.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.573+0000 7fb14bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-15T15:25:26.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.573+0000 7fb14bfff640 10 monclient: _finish_command 1 = system:0 2024-04-15T15:25:26.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.766+0000 7fb1595f6640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-04-15T15:25:26.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.766+0000 7fb1595f6640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-04-15T15:25:26.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.766+0000 7fb1595f6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.38:6790/0 2024-04-15T15:25:26.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.766+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 --> v1:172.21.15.38:6790/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb154123990 con 0x7fb1541474b0 2024-04-15T15:25:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.951+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7fb13c054f30 con 0x7fb1541474b0 2024-04-15T15:25:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.951+0000 7fb14bfff640 10 monclient: handle_config config(1 keys) 2024-04-15T15:25:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.951+0000 7fb151ffb640 4 set_mon_vals no callback set 2024-04-15T15:25:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.951+0000 7fb151ffb640 10 set_mon_vals mon_health_to_clog = false 2024-04-15T15:25:26.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.951+0000 7fb14bfff640 1 -- 172.21.15.38:0/3220814700 <== mon.2 v1:172.21.15.38:6790/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v7)=0 v7) ==== 123+0+0 (unknown 3414686427 0 0) 0x7fb13c0592e0 con 0x7fb1541474b0 2024-04-15T15:25:26.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.952+0000 7fb14bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-04-15T15:25:26.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.952+0000 7fb14bfff640 10 monclient: _finish_command 2 = system:0 2024-04-15T15:25:26.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.953+0000 7fb1595f6640 10 librados: watch_flush enter 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.953+0000 7fb1595f6640 10 librados: watch_flush exit 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.953+0000 7fb1595f6640 20 client.81131.objecter shutdown clearing up homeless session... 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.953+0000 7fb1595f6640 10 client.81131.objecter successfully canceled tick 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.954+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 >> v1:172.21.15.38:6800/1608957829 conn(0x7fb13406efe0 legacy=0x7fb1340714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.954+0000 7fb1595f6640 10 monclient: shutdown 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.954+0000 7fb1595f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.954+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 >> v1:172.21.15.38:6790/0 conn(0x7fb1541474b0 legacy=0x7fb154141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.954+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 shutdown_connections 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.954+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 >> 172.21.15.38:0/3220814700 conn(0x7fb1540b6bf0 msgr2=0x7fb1540b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.954+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 shutdown_connections 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.954+0000 7fb1595f6640 1 -- 172.21.15.38:0/3220814700 wait complete. 2024-04-15T15:25:26.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-15T15:25:26.954+0000 7fb1595f6640 1 librados: shutdown 2024-04-15T15:25:26.967 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-15T15:25:26.967 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-15T15:25:26.967 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-15T15:25:26.967 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:25:26.999 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:25:26.990+0000 ac79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 35539) UID: 0 2024-04-15T15:25:26.999 INFO:tasks.ceph.osd.0.smithi038.stderr:2024-04-15T15:25:26.991+0000 ac79640 -1 osd.0 996 *** Got signal Terminated *** 2024-04-15T15:25:31.928 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:09.770 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:31.979 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:09.769 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:31.979 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:09.822 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:31.982 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:09.772 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:31.995 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:09.837 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:31.997 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:09.788 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:32.028 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:09.871 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:32.029 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:09.872 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:32.045 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:09.888 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:33.068 INFO:tasks.ceph.osd.0:Stopped 2024-04-15T15:25:33.069 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-15T15:25:33.069 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:25:33.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:25:33.071+0000 ac79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 35536) UID: 0 2024-04-15T15:25:33.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2024-04-15T15:25:33.072+0000 ac79640 -1 osd.1 998 *** Got signal Terminated *** 2024-04-15T15:25:33.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-15T15:25:37.005 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:14.848 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:37.007 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:14.850 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:37.020 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:14.862 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:37.051 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:14.841 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:37.052 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:14.842 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:37.062 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:14.852 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:37.088 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:14.931 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:37.090 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:14.933 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:37.101 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:14.944 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:39.171 INFO:tasks.ceph.osd.1:Stopped 2024-04-15T15:25:39.171 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-15T15:25:39.171 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:25:39.185 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:25:39.174+0000 ac79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 35551) UID: 0 2024-04-15T15:25:39.185 INFO:tasks.ceph.osd.2.smithi038.stderr:2024-04-15T15:25:39.175+0000 ac79640 -1 osd.2 1000 *** Got signal Terminated *** 2024-04-15T15:25:39.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-15T15:25:39.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-15T15:25:45.272 INFO:tasks.ceph.osd.2:Stopped 2024-04-15T15:25:45.273 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-15T15:25:45.273 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:25:45.287 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:25:45.276+0000 ac79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 35550) UID: 0 2024-04-15T15:25:45.287 INFO:tasks.ceph.osd.3.smithi038.stderr:2024-04-15T15:25:45.278+0000 ac79640 -1 osd.3 1002 *** Got signal Terminated *** 2024-04-15T15:25:45.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-15T15:25:45.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-15T15:25:46.990 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:24.833 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:47.035 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:24.878 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:47.037 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:24.827 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:47.040 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:24.883 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:47.040 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:24.830 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:47.043 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:24.886 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:47.052 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:24.895 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:47.054 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:24.844 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:47.065 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:24.908 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:51.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-15T15:25:57.004 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:34.846 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:57.054 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:34.844 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:57.056 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:34.899 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:57.057 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:34.847 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:57.068 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:34.859 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:57.074 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:34.916 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:57.110 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:34.953 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:57.111 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:34.955 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:57.122 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:34.965 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:25:57.476 INFO:tasks.ceph.osd.3:Stopped 2024-04-15T15:25:57.477 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-15T15:25:57.477 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:25:57.490 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T15:25:57.480+0000 ac79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 35382) UID: 0 2024-04-15T15:25:57.490 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-15T15:25:57.481+0000 ac79640 -1 osd.4 1004 *** Got signal Terminated *** 2024-04-15T15:25:57.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-15T15:26:03.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-15T15:26:03.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-15T15:26:03.579 INFO:tasks.ceph.osd.4:Stopped 2024-04-15T15:26:03.579 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-15T15:26:03.579 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:26:03.594 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:26:03.583+0000 ac79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 35384) UID: 0 2024-04-15T15:26:03.595 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-15T15:26:03.584+0000 ac79640 -1 osd.5 1006 *** Got signal Terminated *** 2024-04-15T15:26:07.086 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:44.928 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:07.090 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:44.933 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:07.106 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:44.948 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:07.137 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:44.927 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:07.141 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:44.985 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:07.142 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:44.932 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:07.143 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:44.986 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:07.156 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:44.946 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:07.157 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:45.000 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:09.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-15T15:26:17.112 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:54.955 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:17.117 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:54.960 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:17.130 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:54.972 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:17.165 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:54.955 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:17.166 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:54.957 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:17.166 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:55.009 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:17.168 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:55.011 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:17.177 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:54.968 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:17.178 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:55.021 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.448 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:58.291 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.450 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:58.293 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.465 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:27:58.307 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.500 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:58.290 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.501 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:58.292 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.515 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:27:58.305 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.524 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:58.367 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.525 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:58.369 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.543 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:27:58.383 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:20.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-15T15:26:21.883 INFO:tasks.ceph.osd.5:Stopped 2024-04-15T15:26:21.884 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-15T15:26:21.884 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:26:21.899 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:26:21.887+0000 ac79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 35387) UID: 0 2024-04-15T15:26:21.899 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-15T15:26:21.888+0000 ac79640 -1 osd.6 1008 *** Got signal Terminated *** 2024-04-15T15:26:26.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-15T15:26:27.138 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:04.981 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:27.144 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:04.987 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:27.155 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:04.998 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:27.190 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:04.981 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:27.192 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:04.982 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:27.202 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:04.992 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:27.213 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:05.056 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:27.214 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:05.057 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:27.224 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:05.067 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:37.170 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:15.013 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:37.172 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:15.015 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:37.184 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:15.027 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:37.215 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:15.005 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:37.218 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:15.008 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:37.222 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:15.066 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:37.225 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:15.068 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:37.229 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:15.019 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:37.236 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:15.079 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:47.195 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:25.037 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:47.198 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:25.041 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:47.211 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:25.054 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:47.246 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:25.036 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:47.249 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:25.040 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:47.254 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:25.098 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:47.257 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:25.100 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:47.260 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:25.051 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:47.267 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:25.111 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:57.365 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:35.208 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:57.369 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:35.212 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:57.383 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:35.226 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:57.415 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:35.205 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:57.416 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:35.207 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:57.419 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:35.262 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:57.420 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:35.263 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:57.428 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:35.218 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:26:57.432 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:35.275 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:07.269 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:45.112 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:07.271 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:45.114 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:07.283 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:45.126 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:07.318 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:45.108 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:07.320 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:45.110 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:07.322 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:45.165 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:07.323 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:45.166 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:07.331 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:45.121 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:07.335 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:45.178 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:17.328 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:55.171 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:17.331 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:55.173 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:17.343 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:28:55.186 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:17.375 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:55.166 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:17.378 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:55.221 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:17.379 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:55.169 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:17.382 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:55.225 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:17.390 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:28:55.180 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:17.393 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:28:55.236 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:27.328 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:05.170 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:27.330 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:05.173 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:27.348 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:05.191 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:27.377 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:05.167 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:27.380 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:05.170 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:27.386 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:05.229 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:27.389 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:05.232 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:27.392 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:05.183 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:27.408 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:05.251 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:37.357 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:15.199 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:37.357 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:15.147 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:37.359 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:15.202 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:37.379 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:15.222 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:37.405 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:15.196 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:37.414 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:15.257 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:37.418 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:15.261 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:37.418 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:15.209 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:37.435 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:15.278 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:47.382 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:25.225 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:47.386 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:25.229 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:47.406 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:25.246 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:47.429 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:25.220 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:47.431 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:25.221 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:47.440 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:25.283 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:47.442 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:25.233 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:47.443 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:25.286 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:47.460 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:25.303 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:57.365 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:35.208 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:57.413 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:35.203 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:57.414 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:35.204 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:57.417 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:35.260 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:57.420 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:35.263 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:57.421 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:35.264 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:57.427 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:35.217 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:57.434 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:35.277 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:27:57.437 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:35.280 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:07.539 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:45.382 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:07.541 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:45.384 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:07.554 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:45.397 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:07.588 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:45.379 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:07.589 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:45.380 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:07.590 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:45.434 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:07.592 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:45.435 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:07.602 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:45.392 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:07.605 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:45.448 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:17.471 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:55.314 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:17.523 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:55.366 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:17.535 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:29:55.378 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:17.570 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:55.361 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:17.571 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:55.414 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:17.571 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:55.362 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:17.575 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:55.418 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:17.583 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:29:55.373 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:17.591 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:29:55.434 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:27.548 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:05.390 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:27.552 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:05.395 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:27.566 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:05.409 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:27.596 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:05.386 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:27.600 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:05.390 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:27.605 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:05.448 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:27.606 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:05.450 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:27.613 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:05.403 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:27.620 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:05.463 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:37.578 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:15.420 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:37.579 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:15.422 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:37.593 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:15.436 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:37.625 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:15.416 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:37.626 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:15.417 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:37.629 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:15.472 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:37.630 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:15.473 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:37.641 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:15.432 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:37.643 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:15.486 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:47.607 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:25.449 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:47.610 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:25.453 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:47.622 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:25.465 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:47.657 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:25.448 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:47.659 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:25.449 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:47.662 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:25.505 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:47.663 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:25.506 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:47.670 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:25.460 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:47.678 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:25.522 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:57.633 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:35.475 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:57.634 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:35.477 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:57.648 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:35.490 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:57.683 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:35.473 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:57.684 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:35.527 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:57.685 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:35.475 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:57.685 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:35.528 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:57.697 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:35.487 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:28:57.698 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:35.542 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:07.664 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:45.507 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:07.666 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:45.509 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:07.679 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:45.522 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:07.712 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:45.502 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:07.713 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:45.504 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:07.716 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:45.559 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:07.718 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:45.561 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:07.725 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:45.515 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:07.729 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:45.573 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:17.784 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:55.627 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:17.812 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:55.655 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:17.826 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:30:55.669 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:17.836 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:55.680 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:17.854 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:55.697 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:17.877 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:30:55.721 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:17.879 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:55.669 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:17.884 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:55.674 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:17.897 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:30:55.687 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:22.688 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:00.531 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:22.742 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:00.584 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:22.757 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:00.600 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:22.799 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:00.589 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:22.800 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:00.591 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:22.809 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:00.652 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:22.811 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:00.654 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:22.813 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:00.603 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:22.824 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:00.667 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:37.764 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:15.606 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:37.765 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:15.608 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:37.781 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:15.623 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:37.810 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:15.601 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:37.814 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:15.604 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:37.814 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:15.657 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:37.815 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:15.659 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:37.829 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:15.619 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:37.831 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:15.674 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:42.778 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:20.620 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:42.782 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:20.625 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:42.796 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:20.639 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:42.826 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:20.616 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:42.827 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:20.617 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:42.832 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:20.675 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:42.835 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:20.678 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:42.837 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:20.628 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:42.845 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:20.688 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:57.819 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:35.662 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:57.821 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:35.664 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:57.840 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:35.683 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:57.869 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:35.660 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:57.871 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:35.661 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:57.877 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:35.720 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:57.879 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:35.722 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:57.886 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:35.677 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:29:57.894 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:35.738 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:02.835 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:40.677 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:02.836 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:40.679 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:02.847 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:40.690 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:02.883 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:40.673 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:02.884 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:40.675 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:02.885 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:40.728 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:02.888 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:40.731 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:02.894 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:40.684 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:02.897 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:40.741 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:04.002 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:41.844 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:04.003 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:41.846 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:04.018 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:41.860 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:04.054 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:41.844 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:04.055 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:41.845 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:04.057 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:41.900 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:04.060 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:41.903 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:04.068 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:41.859 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:04.074 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:41.917 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:17.826 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:55.668 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:17.873 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:55.664 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:17.874 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:55.665 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:17.877 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:55.720 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:17.890 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:31:55.681 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:17.893 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:31:55.736 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:17.928 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:55.771 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:17.931 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:55.775 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:17.946 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:31:55.789 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:22.895 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:00.737 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:22.896 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:00.739 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:22.907 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:00.750 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:22.943 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:00.733 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:22.944 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:00.734 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:22.947 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:00.790 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:22.949 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:00.792 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:22.954 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:00.744 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:22.960 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:00.803 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:37.885 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:15.727 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:37.934 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:15.723 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:37.934 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:15.725 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:37.936 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:15.779 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:37.951 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:15.742 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:37.954 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:15.797 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:37.989 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:15.832 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:37.990 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:15.833 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:38.005 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:15.849 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:42.945 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:20.788 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:42.949 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:20.792 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:42.960 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:20.803 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:42.993 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:20.783 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:42.994 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:20.784 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:43.000 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:20.844 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:43.003 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:20.794 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:43.025 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:20.868 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:43.035 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:20.878 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:58.065 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:35.908 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:58.114 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:35.904 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:58.116 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:35.958 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:58.116 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:35.907 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:58.131 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:35.922 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:58.132 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:35.975 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:58.167 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:36.010 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:58.171 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:36.014 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:30:58.186 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:36.029 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:02.970 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:40.812 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:03.020 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:40.863 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:03.031 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:40.874 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:03.071 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:40.861 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:03.072 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:40.863 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:03.074 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:40.917 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:03.075 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:40.919 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:03.082 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:40.873 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:03.086 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:40.929 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:18.056 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:55.898 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:18.060 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:55.903 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:18.076 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:55.918 35247== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:18.109 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:55.899 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:18.110 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:55.953 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:18.110 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:55.901 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:18.113 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:55.956 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:18.125 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:32:55.915 34848== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:18.135 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:32:55.978 35250== Warning: unimplemented fcntl command: 1036 2024-04-15T15:31:20.958 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-15T15:31:20.958 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-15T15:31:20.959 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:31:20.960 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T15:31:20.958+0000 7fb9bfd60640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 35253) UID: 0 2024-04-15T15:31:20.960 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-15T15:31:20.958+0000 7fb9bfd60640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-15T15:31:20.989 INFO:tasks.ceph.mgr.y:Stopped 2024-04-15T15:31:20.989 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-15T15:31:20.989 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:31:21.014 INFO:tasks.ceph.mgr.x:Stopped 2024-04-15T15:31:21.015 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-15T15:31:21.015 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-15T15:31:21.015 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:31:21.045 INFO:tasks.ceph.mon.a.smithi038.stderr:2024-04-15T15:31:21.033+0000 9f9b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 35213) UID: 0 2024-04-15T15:31:21.046 INFO:tasks.ceph.mon.a.smithi038.stderr:2024-04-15T15:31:21.034+0000 9f9b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-15T15:31:21.579 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:59.422 35247== 2024-04-15T15:31:21.579 INFO:tasks.ceph.mon.a.smithi038.stderr:==00:00:32:59.422 35247== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T15:31:21.600 INFO:tasks.ceph.mon.a.smithi038.stderr:daemon-helper: command failed with exit status 42 2024-04-15T15:31:22.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-15T15:31:27.117 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T15:31:27.118 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi038 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-04-15T15:31:27.120 INFO:tasks.ceph.mon.a:Stopped 2024-04-15T15:31:27.120 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-15T15:31:27.120 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:31:27.137 INFO:tasks.ceph.mon.c.smithi038.stderr:2024-04-15T15:31:27.124+0000 9f9b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 35215) UID: 0 2024-04-15T15:31:27.137 INFO:tasks.ceph.mon.c.smithi038.stderr:2024-04-15T15:31:27.125+0000 9f9b640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-04-15T15:31:27.731 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:33:05.574 35250== 2024-04-15T15:31:27.731 INFO:tasks.ceph.mon.c.smithi038.stderr:==00:00:33:05.574 35250== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T15:31:27.750 INFO:tasks.ceph.mon.c.smithi038.stderr:daemon-helper: command failed with exit status 42 2024-04-15T15:31:28.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-15T15:31:28.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-15T15:31:33.221 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T15:31:33.222 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi038 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-04-15T15:31:33.222 INFO:tasks.ceph.mon.c:Stopped 2024-04-15T15:31:33.222 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-15T15:31:33.223 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T15:31:33.237 INFO:tasks.ceph.mon.b.smithi164.stderr:2024-04-15T15:31:33.225+0000 9f9b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 34844) UID: 0 2024-04-15T15:31:33.238 INFO:tasks.ceph.mon.b.smithi164.stderr:2024-04-15T15:31:33.227+0000 9f9b640 -1 mon.b@1(probing) e1 *** Got Signal Terminated *** 2024-04-15T15:31:33.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-15T15:31:33.851 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:33:11.641 34848== 2024-04-15T15:31:33.851 INFO:tasks.ceph.mon.b.smithi164.stderr:==00:00:33:11.641 34848== Exit program on first error (--exit-on-first-error=yes) 2024-04-15T15:31:33.868 INFO:tasks.ceph.mon.b.smithi164.stderr:daemon-helper: command failed with exit status 42 2024-04-15T15:31:38.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-15T15:31:39.325 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-15T15:31:39.325 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi164 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-04-15T15:31:39.326 INFO:tasks.ceph.mon.b:Stopped 2024-04-15T15:31:39.326 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-15T15:31:39.327 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | head -n 1 2024-04-15T15:31:39.370 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T15:31:39.370 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-15T15:31:39.537 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T15:31:39.537 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-15T15:31:39.612 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T15:31:39.612 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-15T15:31:39.694 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T15:31:39.695 DEBUG:teuthology.orchestra.run.smithi038:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-15T15:31:39.761 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T15:31:39.761 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-15T15:31:39.903 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T15:31:39.903 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-15T15:31:39.975 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T15:31:39.975 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-15T15:31:40.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T15:31:40.052 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.104 INFO:teuthology.orchestra.run.smithi164.stderr:umount: /var/lib/ceph/osd/ceph-7: target is busy. 2024-04-15T15:31:40.105 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-15T15:31:40.106 DEBUG:teuthology.orchestra.run.smithi164:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2024-04-15T15:31:40.376 INFO:teuthology.orchestra.run.smithi164.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-04-15T15:31:40.376 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 597770 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-15T15:31:40.377 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.378 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 4u a_inode 0,14 0 1085 [eventpoll:5,6,8,9,11,14,15,16,17,18,19,44,45,47,48,50,54,57,58,59,60,64,65,66,90,103,111,113,115,127,128,130...] 2024-04-15T15:31:40.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 5u a_inode 0,14 0 1085 [signalfd] 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 6r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 8u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 9u a_inode 0,14 0 1085 [eventpoll:10,13] 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 10r REG 0,20 0 14994 /proc/1/mountinfo 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 11r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 12u netlink 0t0 18147 AUDIT 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 13r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 15u netlink 0t0 18139 KOBJECT_UEVENT 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 16u unix 0xffff92a058321400 0t0 18141 /run/systemd/private type=STREAM (LISTEN) 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 17r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 18u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 19r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.380 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 20u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 21u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 22u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 23u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 24u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 25u unix 0xffff92a040bd6e00 0t0 18533 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 26u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 28u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 29u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 30u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 31u a_inode 0,14 0 1085 bpf-prog 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 44u unix 0xffff92a05822e400 0t0 15002 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 45u unix 0xffff92a05822a300 0t0 15001 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2024-04-15T15:31:40.381 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 47u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 48u unix 0xffff92a0580b9400 0t0 14996 /run/systemd/notify type=DGRAM (CONNECTED) 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 50u unix 0xffff92a0580be900 0t0 14997 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 51u unix 0xffff92a0580bcb00 0t0 14998 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 54r FIFO 0,13 0t0 18151 pipe 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 57u FIFO 0,24 0t0 453 /run/initctl 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 58u unix 0xffff92a058849900 0t0 16541 /run/systemd/coredump type=SEQPACKET (LISTEN) 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 59u CHR 10,242 0t0 165 /dev/rfkill 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 60u unix 0xffff92a0588c4b00 0t0 20926 type=STREAM (CONNECTED) 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 61u unix 0xffff92a0580b8500 0t0 15011 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 62u unix 0xffff92a05822df00 0t0 15013 /run/systemd/journal/stdout type=STREAM (LISTEN) 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 63u unix 0xffff92a0580bb700 0t0 15009 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 64u FIFO 0,24 0t0 447 /run/dmeventd-server 2024-04-15T15:31:40.382 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 65u FIFO 0,24 0t0 448 /run/dmeventd-client 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 66u unix 0xffff92a058857300 0t0 16529 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 67u unix 0xffff92a058856e00 0t0 16531 /run/rpcbind.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 68u IPv4 18158 0t0 TCP *:sunrpc (LISTEN) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 69u IPv4 19567 0t0 UDP *:sunrpc 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 83u IPv6 18164 0t0 TCP *:sunrpc (LISTEN) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 84u IPv6 18170 0t0 UDP *:sunrpc 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 90u unix 0xffff92a0588c4100 0t0 20920 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 95u unix 0xffff92a05884f800 0t0 16543 /run/udev/control type=SEQPACKET (LISTEN) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 96u netlink 0t0 16545 KOBJECT_UEVENT 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 103u unix 0xffff92a047dfe900 0t0 12096 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 104u unix 0xffff92a058229e00 0t0 16788 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 107u unix 0xffff92a043023c00 0t0 18310 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 108u unix 0xffff92a05822c600 0t0 18318 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 110u unix 0xffff92a05822f300 0t0 18323 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.383 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 111u unix 0xffff92a058326900 0t0 19703 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 112u unix 0xffff92a047dfb200 0t0 18663 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 113u unix 0xffff92a058228f00 0t0 19710 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 114u unix 0xffff92a058855a00 0t0 21007 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 115u unix 0xffff92a058022300 0t0 21008 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 126u unix 0xffff92a0588c0a00 0t0 23597 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 127u unix 0xffff92a0588c1e00 0t0 19802 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 128u unix 0xffff92a058320000 0t0 20227 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 130u unix 0xffff92a058320500 0t0 100737 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 1 root 134u unix 0xffff92a0588c5500 0t0 20918 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:kthreadd 2 root txt unknown /proc/2/exe 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.384 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:slub_flus 5 root txt unknown /proc/5/exe 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:netns 6 root txt unknown /proc/6/exe 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 8 root txt unknown /proc/8/exe 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 9 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.385 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 9 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 9 root txt unknown /proc/9/exe 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.386 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 15 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 15 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 15 root txt unknown /proc/15/exe 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:pr/ttyS1 16 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:pr/ttyS1 16 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:pr/ttyS1 16 root txt unknown /proc/16/exe 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_preem 17 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_preem 17 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:rcu_preem 17 root txt unknown /proc/17/exe 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:migration 18 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:migration 18 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:migration 18 root txt unknown /proc/18/exe 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 19 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.387 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 19 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 19 root txt unknown /proc/19/exe 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 23 root txt unknown /proc/23/exe 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:migration 24 root txt unknown /proc/24/exe 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.388 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 27 root txt unknown /proc/27/exe 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 29 root txt unknown /proc/29/exe 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:migration 30 root txt unknown /proc/30/exe 2024-04-15T15:31:40.389 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 33 root txt unknown /proc/33/exe 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 35 root txt unknown /proc/35/exe 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.390 INFO:teuthology.orchestra.run.smithi164.stdout:migration 36 root txt unknown /proc/36/exe 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 39 root txt unknown /proc/39/exe 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 41 root txt unknown /proc/41/exe 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.391 INFO:teuthology.orchestra.run.smithi164.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:migration 42 root txt unknown /proc/42/exe 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 45 root txt unknown /proc/45/exe 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 47 root txt unknown /proc/47/exe 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.392 INFO:teuthology.orchestra.run.smithi164.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:migration 48 root txt unknown /proc/48/exe 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 51 root txt unknown /proc/51/exe 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 53 root txt unknown /proc/53/exe 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.393 INFO:teuthology.orchestra.run.smithi164.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:migration 54 root txt unknown /proc/54/exe 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 57 root txt unknown /proc/57/exe 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:idle_inje 59 root txt unknown /proc/59/exe 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.394 INFO:teuthology.orchestra.run.smithi164.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:migration 60 root txt unknown /proc/60/exe 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 63 root txt unknown /proc/63/exe 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 70 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 70 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 70 root txt unknown /proc/70/exe 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:kdevtmpfs 71 root cwd DIR 0,5 3500 1 / 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:kdevtmpfs 71 root rtd DIR 0,5 3500 1 / 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2024-04-15T15:31:40.395 INFO:teuthology.orchestra.run.smithi164.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:inet_frag 72 root txt unknown /proc/72/exe 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:kauditd 73 root txt unknown /proc/73/exe 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:khungtask 75 root txt unknown /proc/75/exe 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:oom_reape 76 root txt unknown /proc/76/exe 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.396 INFO:teuthology.orchestra.run.smithi164.stdout:writeback 77 root txt unknown /proc/77/exe 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:kcompactd 78 root txt unknown /proc/78/exe 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:ksmd 79 root txt unknown /proc/79/exe 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:khugepage 80 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:khugepage 80 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:khugepage 80 root txt unknown /proc/80/exe 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:cryptd 81 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:cryptd 81 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:cryptd 81 root txt unknown /proc/81/exe 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:kintegrit 82 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.397 INFO:teuthology.orchestra.run.smithi164.stdout:kintegrit 82 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:kintegrit 82 root txt unknown /proc/82/exe 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:kblockd 83 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:kblockd 83 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:kblockd 83 root txt unknown /proc/83/exe 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:blkcg_pun 84 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:blkcg_pun 84 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:blkcg_pun 84 root txt unknown /proc/84/exe 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:tpm_dev_w 85 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:tpm_dev_w 85 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:tpm_dev_w 85 root txt unknown /proc/85/exe 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:md 86 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:md 86 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:md 86 root txt unknown /proc/86/exe 2024-04-15T15:31:40.398 INFO:teuthology.orchestra.run.smithi164.stdout:md_bitmap 87 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:md_bitmap 87 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:md_bitmap 87 root txt unknown /proc/87/exe 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:edac-poll 88 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:edac-poll 88 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:edac-poll 88 root txt unknown /proc/88/exe 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:watchdogd 89 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:watchdogd 89 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:watchdogd 89 root txt unknown /proc/89/exe 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 91 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 91 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 91 root txt unknown /proc/91/exe 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:kswapd0 93 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:kswapd0 93 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:kswapd0 93 root txt unknown /proc/93/exe 2024-04-15T15:31:40.399 INFO:teuthology.orchestra.run.smithi164.stdout:kthrotld 99 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:kthrotld 99 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:kthrotld 99 root txt unknown /proc/99/exe 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:acpi_ther 109 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:acpi_ther 109 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:acpi_ther 109 root txt unknown /proc/109/exe 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:kmpath_rd 110 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:kmpath_rd 110 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:kmpath_rd 110 root txt unknown /proc/110/exe 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:kaluad 111 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:kaluad 111 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:kaluad 111 root txt unknown /proc/111/exe 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:mld 112 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:mld 112 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:mld 112 root txt unknown /proc/112/exe 2024-04-15T15:31:40.400 INFO:teuthology.orchestra.run.smithi164.stdout:ipv6_addr 113 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:ipv6_addr 113 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:ipv6_addr 113 root txt unknown /proc/113/exe 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:kstrp 125 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:kstrp 125 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:kstrp 125 root txt unknown /proc/125/exe 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:zswap-shr 131 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:zswap-shr 131 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:zswap-shr 131 root txt unknown /proc/131/exe 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 132 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 132 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 132 root txt unknown /proc/132/exe 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 239 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.401 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 239 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 239 root txt unknown /proc/239/exe 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 278 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 278 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 278 root txt unknown /proc/278/exe 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 281 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 281 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 281 root txt unknown /proc/281/exe 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 282 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 282 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 282 root txt unknown /proc/282/exe 2024-04-15T15:31:40.402 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 284 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.405 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 284 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.405 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 284 root txt unknown /proc/284/exe 2024-04-15T15:31:40.405 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 288 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 288 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 288 root txt unknown /proc/288/exe 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 289 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 289 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 289 root txt unknown /proc/289/exe 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-wq 432 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-wq 432 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-wq 432 root txt unknown /proc/432/exe 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-rese 433 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-rese 433 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-rese 433 root txt unknown /proc/433/exe 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-dele 437 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-dele 437 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-dele 437 root txt unknown /proc/437/exe 2024-04-15T15:31:40.406 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-auth 438 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-auth 438 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:nvme-auth 438 root txt unknown /proc/438/exe 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:ata_sff 441 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:ata_sff 441 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:ata_sff 441 root txt unknown /proc/441/exe 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:ixgbe 444 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:ixgbe 444 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:ixgbe 444 root txt unknown /proc/444/exe 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_0 451 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_0 451 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_0 451 root txt unknown /proc/451/exe 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 452 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 452 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 452 root txt unknown /proc/452/exe 2024-04-15T15:31:40.407 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_1 453 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_1 453 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_1 453 root txt unknown /proc/453/exe 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 454 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 454 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 454 root txt unknown /proc/454/exe 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_2 455 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_2 455 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_2 455 root txt unknown /proc/455/exe 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 456 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 456 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 456 root txt unknown /proc/456/exe 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_3 457 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_3 457 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_3 457 root txt unknown /proc/457/exe 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 458 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.408 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 458 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 458 root txt unknown /proc/458/exe 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_4 459 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_4 459 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_4 459 root txt unknown /proc/459/exe 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 460 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 460 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 460 root txt unknown /proc/460/exe 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_5 461 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_5 461 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_5 461 root txt unknown /proc/461/exe 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 462 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 462 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 462 root txt unknown /proc/462/exe 2024-04-15T15:31:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_6 463 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_6 463 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_6 463 root txt unknown /proc/463/exe 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 464 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 464 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 464 root txt unknown /proc/464/exe 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_7 465 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_7 465 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_7 465 root txt unknown /proc/465/exe 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 466 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 466 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 466 root txt unknown /proc/466/exe 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_8 467 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_8 467 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.410 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_8 467 root txt unknown /proc/467/exe 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 468 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 468 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 468 root txt unknown /proc/468/exe 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_9 469 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_9 469 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_eh_9 469 root txt unknown /proc/469/exe 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 470 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 470 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:scsi_tmf_ 470 root txt unknown /proc/470/exe 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:jbd2/sda1 499 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:jbd2/sda1 499 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.411 INFO:teuthology.orchestra.run.smithi164.stdout:jbd2/sda1 499 root txt unknown /proc/499/exe 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:ext4-rsv- 500 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:ext4-rsv- 500 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:ext4-rsv- 500 root txt unknown /proc/500/exe 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.412 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-04-15T15:31:40.413 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 1w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 2w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 3u unix 0xffff92a0580bb700 0t0 15009 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 4u unix 0xffff92a0580b8500 0t0 15011 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 5u unix 0xffff92a05822df00 0t0 15013 /run/systemd/journal/stdout type=STREAM (LISTEN) 2024-04-15T15:31:40.414 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 6w CHR 1,11 0t0 10 /dev/kmsg 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 7u a_inode 0,14 0 1085 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,23,24,25,27,28,29,30,31,32] 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 8u CHR 1,11 0t0 10 /dev/kmsg 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 9u unix 0xffff92a0588c5000 0t0 15721 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 10r REG 0,20 0 11770 /proc/sys/kernel/hostname 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 11u a_inode 0,14 0 1085 [signalfd] 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 12u a_inode 0,14 0 1085 [signalfd] 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 13u a_inode 0,14 0 1085 [signalfd] 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 14u unix 0xffff92a50ebbcb00 0t0 15722 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 15u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 17u unix 0xffff92a047dfe900 0t0 12096 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 18u unix 0xffff92a043023c00 0t0 18310 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 19u unix 0xffff92a05822c600 0t0 18318 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 20u unix 0xffff92a058229e00 0t0 16788 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.415 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 21u unix 0xffff92a058320000 0t0 20227 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 23u unix 0xffff92a05822f300 0t0 18323 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 24u unix 0xffff92a058326900 0t0 19703 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 25u unix 0xffff92a047dfb200 0t0 18663 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 27u unix 0xffff92a058855a00 0t0 21007 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 28u unix 0xffff92a058022300 0t0 21008 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 29u unix 0xffff92a058228f00 0t0 19710 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 30u unix 0xffff92a0588c0a00 0t0 23597 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 31u unix 0xffff92a058320500 0t0 100737 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-j 575 root 32u unix 0xffff92a0588c1e00 0t0 19802 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:ext4lazyi 581 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:ext4lazyi 581 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:ext4lazyi 581 root txt unknown /proc/581/exe 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.416 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 597770 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 587295 265301 /usr/lib/modules/5.14.0-438.el9.x86_64/modules.symbols.bin 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 830988 265298 /usr/lib/modules/5.14.0-438.el9.x86_64/modules.alias.bin 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 399220 265307 /usr/lib/modules/5.14.0-438.el9.x86_64/modules.dep.bin 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.417 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-04-15T15:31:40.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 11519 265302 /usr/lib/modules/5.14.0-438.el9.x86_64/modules.builtin.bin 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.419 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 1u unix 0xffff92a047df9400 0t0 19586 type=STREAM (CONNECTED) 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 2u unix 0xffff92a047df9400 0t0 19586 type=STREAM (CONNECTED) 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 3u netlink 0t0 16545 KOBJECT_UEVENT 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 4u unix 0xffff92a05884f800 0t0 16543 /run/udev/control type=SEQPACKET (LISTEN) 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 5u unix 0xffff92a042cd9900 0t0 19598 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 6u unix 0xffff92a042cdda00 0t0 19602 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 7u unix 0xffff92a042cdf800 0t0 19603 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 9u a_inode 0,14 0 1085 [eventpoll:3,4,6,8,10,11,14] 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 10u a_inode 0,14 0 1085 [signalfd] 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 11u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-u 593 root 14u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:ipmi-msgh 635 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:ipmi-msgh 635 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.420 INFO:teuthology.orchestra.run.smithi164.stdout:ipmi-msgh 635 root txt unknown /proc/635/exe 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:kipmi0 644 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:kipmi0 644 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:kipmi0 644 root txt unknown /proc/644/exe 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.421 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.422 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc 1u unix 0xffff92a058228500 0t0 15263 type=STREAM (CONNECTED) 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc 2u unix 0xffff92a058228500 0t0 15263 type=STREAM (CONNECTED) 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc 3u unix 0xffff92a058856e00 0t0 16531 /run/rpcbind.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc 4u IPv4 18158 0t0 TCP *:sunrpc (LISTEN) 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc 5u IPv4 19567 0t0 UDP *:sunrpc 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc 6u IPv6 18164 0t0 TCP *:sunrpc (LISTEN) 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc 7u IPv6 18170 0t0 UDP *:sunrpc 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpcbind 664 rpc 8rW REG 0,24 0 1045 /run/rpcbind/rpcbind.lock 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpciod 666 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpciod 666 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:rpciod 666 root txt unknown /proc/666/exe 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:xprtiod 667 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:xprtiod 667 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.423 INFO:teuthology.orchestra.run.smithi164.stdout:xprtiod 667 root txt unknown /proc/667/exe 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.424 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 3u netlink 0t0 18615 AUDIT 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 4w REG 8,1 2596543 64150 /var/log/audit/audit.log 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 6u unix 0xffff92a040bd1900 0t0 18618 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 7u unix 0xffff92a043026e00 0t0 18617 type=STREAM (CONNECTED) 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 8u unix 0xffff92a043024600 0t0 18619 type=STREAM (CONNECTED) 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 9u unix 0xffff92a043021e00 0t0 18620 type=STREAM (CONNECTED) 2024-04-15T15:31:40.425 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 root 10u a_inode 0,14 0 1085 [eventfd:0] 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.426 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 3u netlink 0t0 18615 AUDIT 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 4w REG 8,1 2596543 64150 /var/log/audit/audit.log 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 6u unix 0xffff92a040bd1900 0t0 18618 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 7u unix 0xffff92a043026e00 0t0 18617 type=STREAM (CONNECTED) 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 8u unix 0xffff92a043024600 0t0 18619 type=STREAM (CONNECTED) 2024-04-15T15:31:40.427 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 9u unix 0xffff92a043021e00 0t0 18620 type=STREAM (CONNECTED) 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 672 auditd root 10u a_inode 0,14 0 1085 [eventfd:0] 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 3u netlink 0t0 18615 AUDIT 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 4w REG 8,1 2596543 64150 /var/log/audit/audit.log 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 6u unix 0xffff92a040bd1900 0t0 18618 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 7u unix 0xffff92a043026e00 0t0 18617 type=STREAM (CONNECTED) 2024-04-15T15:31:40.429 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 8u unix 0xffff92a043024600 0t0 18619 type=STREAM (CONNECTED) 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 9u unix 0xffff92a043021e00 0t0 18620 type=STREAM (CONNECTED) 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:auditd 671 675 auditd root 10u a_inode 0,14 0 1085 [eventfd:0] 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.430 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root 0u unix 0xffff92a043020500 0t0 18616 type=STREAM (CONNECTED) 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:sedispatc 674 root 3u unix 0xffff92a043022d00 0t0 26795 type=STREAM (CONNECTED) 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.431 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus DEL REG 0,1 2 /memfd:dbus-broker-log 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.432 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 1u unix 0xffff92a043020000 0t0 18648 type=STREAM (CONNECTED) 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 2u unix 0xffff92a043020000 0t0 18648 type=STREAM (CONNECTED) 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 3u unix 0xffff92a0588c5500 0t0 20918 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 4u unix 0xffff92a040bd5a00 0t0 18658 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 5u a_inode 0,14 0 1085 [eventpoll:6,7,8,9,10,11] 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 6u a_inode 0,14 0 1085 [signalfd] 2024-04-15T15:31:40.433 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 7r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 8u unix 0xffff92a043025f00 0t0 18660 type=STREAM (CONNECTED) 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 9u unix 0xffff92a043026400 0t0 18662 type=STREAM (CONNECTED) 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 10u a_inode 0,14 0 1085 [pidfd:714] 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 11u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 713 dbus 12u REG 0,1 2097152 2 /memfd:dbus-broker-log (deleted) 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.434 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 1u unix 0xffff92a043020000 0t0 18648 type=STREAM (CONNECTED) 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 2u unix 0xffff92a043020000 0t0 18648 type=STREAM (CONNECTED) 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 3u sock 0,8 0t0 18313 protocol: NETLINK 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 4u unix 0xffff92a040bd5a00 0t0 18658 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 5u a_inode 0,14 0 1085 [eventpoll:6,7,8,9,10,11,12,13,14,15,16,18] 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 6u a_inode 0,14 0 1085 [signalfd] 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 7u unix 0xffff92a0588c5500 0t0 20918 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-04-15T15:31:40.435 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 8u unix 0xffff92a0588c2d00 0t0 18314 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 9u unix 0xffff92a043022300 0t0 18661 type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 10u unix 0xffff92a043021400 0t0 18316 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 11u unix 0xffff92a05822bc00 0t0 18334 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 12u unix 0xffff92a058322d00 0t0 22538 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 13u unix 0xffff92a05822e900 0t0 18370 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 14u unix 0xffff92a043020f00 0t0 24350 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 15u unix 0xffff92a047dfa300 0t0 16911 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 16u unix 0xffff92a058326e00 0t0 23338 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:dbus-brok 714 dbus 18u unix 0xffff92a058229900 0t0 23643 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2024-04-15T15:31:40.436 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.437 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.438 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.439 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-04-15T15:31:40.440 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.441 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 1u unix 0xffff92a058228a00 0t0 15293 type=STREAM (CONNECTED) 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 2u unix 0xffff92a058228a00 0t0 15293 type=STREAM (CONNECTED) 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 3u a_inode 0,14 0 1085 [eventfd:6] 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 4u a_inode 0,14 0 1085 [eventfd:7] 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 5u unix 0xffff92a0580bc100 0t0 22540 type=DGRAM (UNCONNECTED) 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 6u unix 0xffff92a05822d000 0t0 22541 type=STREAM (CONNECTED) 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 7u a_inode 0,14 0 1085 [eventfd:8] 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 8r REG 0,4 0 4026531840 net 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 9r REG 0,4 0 4026532495 mnt 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 10u netlink 0t0 22545 KOBJECT_UEVENT 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 11u netlink 0t0 22546 GENERIC 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 12u netlink 0t0 22547 GENERIC 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 13u netlink 0t0 22548 ROUTE 2024-04-15T15:31:40.442 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 14r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 15r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 16u netlink 0t0 22581 KOBJECT_UEVENT 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 17u a_inode 0,14 0 1085 [eventpoll] 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 18u unix 0xffff92a047dff800 0t0 19769 type=STREAM (CONNECTED) 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 19u a_inode 0,14 0 1085 [eventpoll:21,26] 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 20w FIFO 0,24 0t0 1167 /run/systemd/inhibit/1.ref 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 21u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 23u a_inode 0,14 0 1085 [eventpoll:24,25] 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 24u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 25u pack 18744 0t0 ARP type=SOCK_DGRAM 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 root 26u IPv4 18745 0t0 UDP smithi164.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2024-04-15T15:31:40.443 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.444 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.445 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.446 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.447 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.448 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 1u unix 0xffff92a058228a00 0t0 15293 type=STREAM (CONNECTED) 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 2u unix 0xffff92a058228a00 0t0 15293 type=STREAM (CONNECTED) 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 3u a_inode 0,14 0 1085 [eventfd:6] 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 4u a_inode 0,14 0 1085 [eventfd:7] 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 5u unix 0xffff92a0580bc100 0t0 22540 type=DGRAM (UNCONNECTED) 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 6u unix 0xffff92a05822d000 0t0 22541 type=STREAM (CONNECTED) 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 7u a_inode 0,14 0 1085 [eventfd:8] 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 8r REG 0,4 0 4026531840 net 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 9r REG 0,4 0 4026532495 mnt 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 10u netlink 0t0 22545 KOBJECT_UEVENT 2024-04-15T15:31:40.449 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 11u netlink 0t0 22546 GENERIC 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 12u netlink 0t0 22547 GENERIC 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 13u netlink 0t0 22548 ROUTE 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 14r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 15r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 16u netlink 0t0 22581 KOBJECT_UEVENT 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 17u a_inode 0,14 0 1085 [eventpoll] 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 18u unix 0xffff92a047dff800 0t0 19769 type=STREAM (CONNECTED) 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 19u a_inode 0,14 0 1085 [eventpoll:21,26] 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 20w FIFO 0,24 0t0 1167 /run/systemd/inhibit/1.ref 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 21u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 23u a_inode 0,14 0 1085 [eventpoll:24,25] 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 24u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 25u pack 18744 0t0 ARP type=SOCK_DGRAM 2024-04-15T15:31:40.450 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 743 gmain root 26u IPv4 18745 0t0 UDP smithi164.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2024-04-15T15:31:40.451 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.452 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.453 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.454 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.455 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 1u unix 0xffff92a058228a00 0t0 15293 type=STREAM (CONNECTED) 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 2u unix 0xffff92a058228a00 0t0 15293 type=STREAM (CONNECTED) 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 3u a_inode 0,14 0 1085 [eventfd:6] 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 4u a_inode 0,14 0 1085 [eventfd:7] 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 5u unix 0xffff92a0580bc100 0t0 22540 type=DGRAM (UNCONNECTED) 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 6u unix 0xffff92a05822d000 0t0 22541 type=STREAM (CONNECTED) 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 7u a_inode 0,14 0 1085 [eventfd:8] 2024-04-15T15:31:40.456 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 8r REG 0,4 0 4026531840 net 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 9r REG 0,4 0 4026532495 mnt 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 10u netlink 0t0 22545 KOBJECT_UEVENT 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 11u netlink 0t0 22546 GENERIC 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 12u netlink 0t0 22547 GENERIC 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 13u netlink 0t0 22548 ROUTE 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 14r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 15r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 16u netlink 0t0 22581 KOBJECT_UEVENT 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 17u a_inode 0,14 0 1085 [eventpoll] 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 18u unix 0xffff92a047dff800 0t0 19769 type=STREAM (CONNECTED) 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 19u a_inode 0,14 0 1085 [eventpoll:21,26] 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 20w FIFO 0,24 0t0 1167 /run/systemd/inhibit/1.ref 2024-04-15T15:31:40.457 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 21u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.458 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 23u a_inode 0,14 0 1085 [eventpoll:24,25] 2024-04-15T15:31:40.458 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 24u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.458 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 25u pack 18744 0t0 ARP type=SOCK_DGRAM 2024-04-15T15:31:40.458 INFO:teuthology.orchestra.run.smithi164.stdout:NetworkMa 715 744 gdbus root 26u IPv4 18745 0t0 UDP smithi164.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-04-15T15:31:40.458 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.458 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.458 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2024-04-15T15:31:40.458 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root 1u unix 0xffff92a05822ee00 0t0 15303 type=STREAM (CONNECTED) 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root 2u unix 0xffff92a05822ee00 0t0 15303 type=STREAM (CONNECTED) 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root 3u a_inode 0,14 0 1085 [eventfd:1] 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root 4u a_inode 0,14 0 1085 [eventfd:2] 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root 5u unix 0xffff92a0588c1900 0t0 20956 /run/irqbalance/irqbalance718.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 root 6u unix 0xffff92a50ebbda00 0t0 21178 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.459 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root 1u unix 0xffff92a05822ee00 0t0 15303 type=STREAM (CONNECTED) 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root 2u unix 0xffff92a05822ee00 0t0 15303 type=STREAM (CONNECTED) 2024-04-15T15:31:40.460 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root 3u a_inode 0,14 0 1085 [eventfd:1] 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root 4u a_inode 0,14 0 1085 [eventfd:2] 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root 5u unix 0xffff92a0588c1900 0t0 20956 /run/irqbalance/irqbalance718.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:irqbalanc 718 725 gmain root 6u unix 0xffff92a50ebbda00 0t0 21178 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt 1u unix 0xffff92a058323200 0t0 18324 type=STREAM (CONNECTED) 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt 2u unix 0xffff92a058323200 0t0 18324 type=STREAM (CONNECTED) 2024-04-15T15:31:40.461 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt 3uW REG 0,24 0 1123 /run/lsm/ipc/.lsmd-ipc-lock 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt 5u unix 0xffff92a058322800 0t0 18330 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:lsmd 719 libstoragemgmt 6u unix 0xffff92a058323700 0t0 18331 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root 1u unix 0xffff92a047dfe400 0t0 19704 type=STREAM (CONNECTED) 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root 2u unix 0xffff92a047dfe400 0t0 19704 type=STREAM (CONNECTED) 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root 3r CHR 10,227 0t0 142 /dev/mcelog 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:mcelog 720 root 4u unix 0xffff92a058020a00 0t0 12166 /var/run/mcelog-client type=STREAM (LISTEN) 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.462 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.463 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.464 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.465 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.466 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.467 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 733 gmain polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.468 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.469 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.470 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 734 gdbus polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.471 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.472 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.473 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 735 JS\x20Hel polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.474 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.475 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.476 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 736 JS\x20Hel polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.478 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.479 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 737 JS\x20Hel polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.480 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.481 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 738 JS\x20Hel polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.482 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.483 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.484 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 739 JS\x20Hel polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.485 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.486 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.487 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 740 JS\x20Hel polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.488 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.489 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.490 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 741 JS\x20Hel polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.491 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.493 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 742 JS\x20Hel polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.494 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.495 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 3r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 4u a_inode 0,14 0 1085 [eventfd:3] 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 5u a_inode 0,14 0 1085 [eventfd:4] 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 6u unix 0xffff92a058320f00 0t0 18369 type=STREAM (CONNECTED) 2024-04-15T15:31:40.496 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 7u a_inode 0,14 0 1085 [eventfd:5] 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 8r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 9u a_inode 0,14 0 1085 [eventfd:10] 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:polkitd 721 747 polkitd polkitd 10u unix 0xffff92a040bd1400 0t0 18681 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 597770 1027 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.497 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 21219 1167 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 1u unix 0xffff92a058228000 0t0 15316 type=STREAM (CONNECTED) 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 2u unix 0xffff92a058228000 0t0 15316 type=STREAM (CONNECTED) 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 3u unix 0xffff92a0580ba800 0t0 15342 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 4u a_inode 0,14 0 1085 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20] 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 5u a_inode 0,14 0 1085 [signalfd] 2024-04-15T15:31:40.499 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 6u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 7r REG 0,21 4096 22973 /sys/devices/virtual/tty/tty0/active 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 8u netlink 0t0 15353 KOBJECT_UEVENT 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 9r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 10r FIFO 0,24 0t0 1167 /run/systemd/inhibit/1.ref 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 11u netlink 0t0 15354 KOBJECT_UEVENT 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 12u netlink 0t0 15355 KOBJECT_UEVENT 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 13u netlink 0t0 15356 KOBJECT_UEVENT 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 14u unix 0xffff92a05822b700 0t0 15357 type=STREAM (CONNECTED) 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 15u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 16u CHR 13,65 0t0 138 /dev/input/event1 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 17u CHR 13,64 0t0 137 /dev/input/event0 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 18u CHR 13,66 0t0 148 /dev/input/event2 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 19u CHR 4,6 0t0 25 /dev/tty6 2024-04-15T15:31:40.500 INFO:teuthology.orchestra.run.smithi164.stdout:systemd-l 724 root 20r FIFO 0,24 0t0 1676 /run/systemd/sessions/4.ref 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.501 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.502 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root 1u unix 0xffff92a058020000 0t0 12173 type=STREAM (CONNECTED) 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root 2u unix 0xffff92a058020000 0t0 12173 type=STREAM (CONNECTED) 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root 3u IPv4 12183 0t0 TCP *:ssh (LISTEN) 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 777 root 4u IPv6 12185 0t0 TCP *:ssh (LISTEN) 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.503 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.504 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.505 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.506 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root 1u unix 0xffff92a0588c7300 0t0 21009 type=STREAM (CONNECTED) 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root 2u unix 0xffff92a0588c7300 0t0 21009 type=STREAM (CONNECTED) 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root 4u sock 0,8 0t0 22659 protocol: NETLINK 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root 5u unix 0xffff92a05822f800 0t0 22683 type=STREAM (CONNECTED) 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root 6u a_inode 0,14 0 1085 [eventfd:17] 2024-04-15T15:31:40.507 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root 7u unix 0xffff92a047dfc600 0t0 19810 type=STREAM (CONNECTED) 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 root 8u unix 0xffff92a047df9e00 0t0 19811 type=STREAM (CONNECTED) 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-04-15T15:31:40.508 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.509 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.510 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.511 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root 1u unix 0xffff92a0588c7300 0t0 21009 type=STREAM (CONNECTED) 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root 2u unix 0xffff92a0588c7300 0t0 21009 type=STREAM (CONNECTED) 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root 4u sock 0,8 0t0 22659 protocol: NETLINK 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root 5u unix 0xffff92a05822f800 0t0 22683 type=STREAM (CONNECTED) 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root 6u a_inode 0,14 0 1085 [eventfd:17] 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root 7u unix 0xffff92a047dfc600 0t0 19810 type=STREAM (CONNECTED) 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:tuned 778 863 tuned root 8u unix 0xffff92a047df9e00 0t0 19811 type=STREAM (CONNECTED) 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.512 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.513 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.514 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 1u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 2u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 3u unix 0xffff92a50ddf8a00 0t0 23606 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 4r FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.515 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 5u a_inode 0,14 0 1085 [eventpoll:4,6,7,8] 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 6u a_inode 0,14 0 1085 [eventfd:16] 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 7u unix 0xffff92a058325000 0t0 23607 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 8u unix 0xffff92a058327800 0t0 23608 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 root 9w FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-04-15T15:31:40.516 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.517 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.518 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 1u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 2u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 3u unix 0xffff92a50ddf8a00 0t0 23606 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 4r FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 5u a_inode 0,14 0 1085 [eventpoll:4,6,7,8] 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 6u a_inode 0,14 0 1085 [eventfd:16] 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 7u unix 0xffff92a058325000 0t0 23607 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 8u unix 0xffff92a058327800 0t0 23608 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 783 gssproxy root 9w FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.519 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.520 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.521 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 1u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 2u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 3u unix 0xffff92a50ddf8a00 0t0 23606 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.522 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 4r FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 5u a_inode 0,14 0 1085 [eventpoll:4,6,7,8] 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 6u a_inode 0,14 0 1085 [eventfd:16] 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 7u unix 0xffff92a058325000 0t0 23607 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 8u unix 0xffff92a058327800 0t0 23608 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 784 gssproxy root 9w FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-04-15T15:31:40.523 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.524 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.525 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 1u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 2u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 3u unix 0xffff92a50ddf8a00 0t0 23606 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 4r FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 5u a_inode 0,14 0 1085 [eventpoll:4,6,7,8] 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 6u a_inode 0,14 0 1085 [eventfd:16] 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 7u unix 0xffff92a058325000 0t0 23607 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 8u unix 0xffff92a058327800 0t0 23608 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.526 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 785 gssproxy root 9w FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.527 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-04-15T15:31:40.528 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.529 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 1u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 2u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 3u unix 0xffff92a50ddf8a00 0t0 23606 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 4r FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 5u a_inode 0,14 0 1085 [eventpoll:4,6,7,8] 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 6u a_inode 0,14 0 1085 [eventfd:16] 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 7u unix 0xffff92a058325000 0t0 23607 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 8u unix 0xffff92a058327800 0t0 23608 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 786 gssproxy root 9w FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.530 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-04-15T15:31:40.531 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-04-15T15:31:40.532 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 1u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 2u unix 0xffff92a058855000 0t0 16928 type=STREAM (CONNECTED) 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 3u unix 0xffff92a50ddf8a00 0t0 23606 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 4r FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 5u a_inode 0,14 0 1085 [eventpoll:4,6,7,8] 2024-04-15T15:31:40.533 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 6u a_inode 0,14 0 1085 [eventfd:16] 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 7u unix 0xffff92a058325000 0t0 23607 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 8u unix 0xffff92a058327800 0t0 23608 /run/gssproxy.sock type=STREAM (LISTEN) 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:gssproxy 782 787 gssproxy root 9w FIFO 0,13 0t0 23611 pipe 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root cwd DIR 8,1 4096 1657 /var/spool/at 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root txt REG 8,1 32680 12473 /usr/sbin/atd 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.534 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:atd 789 root 3uW REG 0,24 4 1190 /run/atd.pid 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root txt REG 8,1 74552 11234 /usr/sbin/crond 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.536 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root 1u unix 0xffff92a0588c4600 0t0 21016 type=STREAM (CONNECTED) 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root 2u unix 0xffff92a0588c4600 0t0 21016 type=STREAM (CONNECTED) 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root 3uW REG 0,24 4 1191 /run/crond.pid 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root 4u unix 0xffff92a05899d500 0t0 12188 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:crond 790 root 5r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2024-04-15T15:31:40.537 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe 1w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe 2w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe 3u IPv4 21109 0t0 TCP *:nrpe (LISTEN) 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe 4u unix 0xffff92a50ebb9900 0t0 21101 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:nrpe 884 nrpe 5u IPv6 21110 0t0 TCP *:nrpe (LISTEN) 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2024-04-15T15:31:40.538 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root 0u CHR 4,1 0t0 20 /dev/tty1 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root 1u CHR 4,1 0t0 20 /dev/tty1 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root 2u CHR 4,1 0t0 20 /dev/tty1 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1389 root 4r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.539 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root 0u CHR 4,65 0t0 114 /dev/ttyS1 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root 1u CHR 4,65 0t0 114 /dev/ttyS1 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root 2u CHR 4,65 0t0 114 /dev/ttyS1 2024-04-15T15:31:40.540 INFO:teuthology.orchestra.run.smithi164.stdout:agetty 1397 root 4r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu DEL REG 8,1 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu DEL REG 8,1 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-15T15:31:40.541 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-04-15T15:31:40.542 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 1u unix 0xffff92a058322300 0t0 24180 type=STREAM (CONNECTED) 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 2u unix 0xffff92a058322300 0t0 24180 type=STREAM (CONNECTED) 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 3u unix 0xffff92a50ddf9900 0t0 24208 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 4u a_inode 0,14 0 1085 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 5u a_inode 0,14 0 1085 [signalfd] 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 6r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 7r DIR 0,25 0 3393 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-04-15T15:31:40.543 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 8u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 9u a_inode 0,14 0 1085 [eventpoll:10,13] 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 10r REG 0,20 0 24197 /proc/4843/mountinfo 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 11r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 12u unix 0xffff92a058327300 0t0 24230 /run/user/1000/bus type=STREAM (LISTEN) 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 13r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 15u netlink 0t0 24212 KOBJECT_UEVENT 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 16u unix 0xffff92a50ddfda00 0t0 24217 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 17u unix 0xffff92a50ddff800 0t0 24218 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 18u unix 0xffff92a50ddf9400 0t0 24219 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 19u unix 0xffff92a058324600 0t0 24220 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 20u unix 0xffff92a058320a00 0t0 24222 type=STREAM (CONNECTED) 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:systemd 4843 ubuntu 21u a_inode 0,14 0 1085 [timerfd] 2024-04-15T15:31:40.544 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-04-15T15:31:40.545 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.546 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-04-15T15:31:40.547 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu 1u unix 0xffff92a058322300 0t0 24180 type=STREAM (CONNECTED) 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu 2u unix 0xffff92a058322300 0t0 24180 type=STREAM (CONNECTED) 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu 3u a_inode 0,14 0 1085 [eventfd:9] 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu 4u a_inode 0,14 0 1085 [eventfd:11] 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu 6w FIFO 0,13 0t0 24184 pipe 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:(sd-pam) 4845 ubuntu 7u unix 0xffff92a50ddfee00 0t0 24200 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-04-15T15:31:40.548 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2024-04-15T15:31:40.549 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 1w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 2w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 3r CHR 1,9 0t0 9 /dev/urandom 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 4u unix 0xffff92a040bd0500 0t0 26794 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 5r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 6w REG 8,1 1871 1220 /var/log/cron 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 7r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 8w REG 8,1 636912 1642 /var/log/secure 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 root 10w REG 8,1 1580452 1641 /var/log/messages 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.550 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.551 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 4u unix 0xffff92a040bd0500 0t0 26794 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 5r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 6w REG 8,1 1871 1220 /var/log/cron 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 7r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-04-15T15:31:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 8w REG 8,1 636912 1642 /var/log/secure 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5110 in:imjour root 10w REG 8,1 1580452 1641 /var/log/messages 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 4u unix 0xffff92a040bd0500 0t0 26794 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 5r a_inode 0,14 0 1085 inotify 2024-04-15T15:31:40.554 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 6w REG 8,1 1871 1220 /var/log/cron 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 7r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 8w REG 8,1 636912 1642 /var/log/secure 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:rsyslogd 5108 5111 rs:main root 10w REG 8,1 1580452 1641 /var/log/messages 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:tls-strp 15856 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:tls-strp 15856 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:tls-strp 15856 root txt unknown /proc/15856/exe 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root txt REG 8,1 630408 11631 /usr/sbin/smartd 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.555 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:smartd 15903 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.556 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21262 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21262 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21262 root txt unknown /proc/21262/exe 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21291 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21291 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21291 root txt unknown /proc/21291/exe 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21320 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21320 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21320 root txt unknown /proc/21320/exe 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21349 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21349 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21349 root txt unknown /proc/21349/exe 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21378 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.557 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21378 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:kdmflush/ 21378 root txt unknown /proc/21378/exe 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfsalloc 21542 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfsalloc 21542 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfsalloc 21542 root txt unknown /proc/21542/exe 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfs_mru_c 21543 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfs_mru_c 21543 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfs_mru_c 21543 root txt unknown /proc/21543/exe 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-buf/d 21544 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-buf/d 21544 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-buf/d 21544 root txt unknown /proc/21544/exe 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-conv/ 21545 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-conv/ 21545 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.558 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-conv/ 21545 root txt unknown /proc/21545/exe 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-recla 21546 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-recla 21546 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-recla 21546 root txt unknown /proc/21546/exe 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-block 21547 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-block 21547 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-block 21547 root txt unknown /proc/21547/exe 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-inode 21548 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-inode 21548 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-inode 21548 root txt unknown /proc/21548/exe 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-log/d 21549 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-log/d 21549 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-log/d 21549 root txt unknown /proc/21549/exe 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-cil/d 21550 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-cil/d 21550 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.559 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-cil/d 21550 root txt unknown /proc/21550/exe 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:xfsaild/d 21551 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:xfsaild/d 21551 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:xfsaild/d 21551 root txt unknown /proc/21551/exe 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-04-15T15:31:40.560 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-04-15T15:31:40.561 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.562 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-04-15T15:31:40.563 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root 3u unix 0xffff92a05a2e4b00 0t0 93762 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root 4u IPv4 97309 0t0 TCP smithi164.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:36766 (ESTABLISHED) 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root 6u unix 0xffff92a05a204100 0t0 93737 type=STREAM (CONNECTED) 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root 7w FIFO 0,24 0t0 1676 /run/systemd/sessions/4.ref 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23556 root 8u unix 0xffff92a05a200000 0t0 93766 type=STREAM (CONNECTED) 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-04-15T15:31:40.564 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-04-15T15:31:40.565 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.566 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.567 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 3u unix 0xffff92a05a2e4b00 0t0 93762 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 4u IPv4 97309 0t0 TCP smithi164.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:36766 (ESTABLISHED) 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 5u unix 0xffff92a05a200a00 0t0 93765 type=STREAM (CONNECTED) 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 6u unix 0xffff92a05a204100 0t0 93737 type=STREAM (CONNECTED) 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 7w FIFO 0,24 0t0 1676 /run/systemd/sessions/4.ref 2024-04-15T15:31:40.568 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 12r FIFO 0,13 0t0 136673 pipe 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 14r FIFO 0,13 0t0 136674 pipe 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 24r FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 25w FIFO 0,13 0t0 119883 pipe 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 26r FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 27r FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:sshd 23559 ubuntu 29r FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-04-15T15:31:40.569 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.591 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-04-15T15:31:40.591 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.591 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-04-15T15:31:40.591 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.591 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-04-15T15:31:40.591 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.591 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony 1w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony 2u CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony 3u unix 0xffff92a040bd0000 0t0 87925 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony 4u IPv4 136630 0t0 UDP smithi164.front.sepia.ceph.com:58601->hv04.front.sepia.ceph.com:ntp 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony 5u IPv4 87930 0t0 UDP localhost:323 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony 6u IPv6 87931 0t0 UDP localhost:323 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:chronyd 23619 chrony 7u unix 0xffff92a040bd2300 0t0 87932 /run/chrony/chronyd.sock type=DGRAM (UNCONNECTED) 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.592 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.593 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph 1u unix 0xffff92a058321e00 0t0 95875 type=STREAM (CONNECTED) 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-cras 23841 ceph 2u unix 0xffff92a058321e00 0t0 95875 type=STREAM (CONNECTED) 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 25268 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 25268 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 25268 root txt unknown /proc/25268/exe 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 26219 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 26219 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 26219 root txt unknown /proc/26219/exe 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 28313 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 28313 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 28313 root txt unknown /proc/28313/exe 2024-04-15T15:31:40.594 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-buf/d 29668 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-buf/d 29668 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-buf/d 29668 root txt unknown /proc/29668/exe 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-conv/ 29669 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-conv/ 29669 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-conv/ 29669 root txt unknown /proc/29669/exe 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-recla 29670 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-recla 29670 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-recla 29670 root txt unknown /proc/29670/exe 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-block 29671 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-block 29671 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-block 29671 root txt unknown /proc/29671/exe 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-inode 29672 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.595 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-inode 29672 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-inode 29672 root txt unknown /proc/29672/exe 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-log/d 29673 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-log/d 29673 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-log/d 29673 root txt unknown /proc/29673/exe 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-cil/d 29674 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-cil/d 29674 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfs-cil/d 29674 root txt unknown /proc/29674/exe 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfsaild/d 29675 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfsaild/d 29675 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:xfsaild/d 29675 root txt unknown /proc/29675/exe 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:dio/dm-3 33207 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:dio/dm-3 33207 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:dio/dm-3 33207 root txt unknown /proc/33207/exe 2024-04-15T15:31:40.596 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root txt REG 8,1 185296 11759 /usr/bin/sudo 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-04-15T15:31:40.597 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.598 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.599 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.600 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root 0r FIFO 0,13 0t0 115498 pipe 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root 3r FIFO 0,13 0t0 120961 pipe 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root 4w FIFO 0,13 0t0 120961 pipe 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root 5u netlink 0t0 116444 AUDIT 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35326 root 6u unix 0xffff92a50ebb8500 0t0 116445 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root txt REG 8,1 185296 11759 /usr/bin/sudo 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:40.601 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-04-15T15:31:40.602 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.603 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:40.604 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root 0r FIFO 0,13 0t0 119883 pipe 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root 3r FIFO 0,13 0t0 116439 pipe 2024-04-15T15:31:40.605 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root 4w FIFO 0,13 0t0 116439 pipe 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root 5u netlink 0t0 117263 AUDIT 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 35336 root 6u unix 0xffff92a058999900 0t0 117264 type=DGRAM (CONNECTED) 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.606 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root 0r FIFO 0,13 0t0 115498 pipe 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:40.607 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35387 root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.608 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root 0r FIFO 0,13 0t0 119883 pipe 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:daemon-he 35389 root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35395 log root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35400 msgr-work root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35401 msgr-work root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35403 msgr-work root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.668 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.669 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.670 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.671 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.672 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.673 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.674 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.675 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.676 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.677 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35427 service root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.678 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.679 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.680 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.681 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.682 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.683 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.684 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.685 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.686 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.687 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.688 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35428 admin_soc root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.689 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.690 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.691 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.692 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.693 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.694 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.695 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.697 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.698 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.699 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35443 signal_ha root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.700 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.701 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.702 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.703 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.704 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.705 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.706 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.707 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.708 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.709 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.710 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.711 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35444 io_contex root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.712 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.713 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.714 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.715 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.716 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.717 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.718 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.719 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.720 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.721 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.722 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35445 io_contex root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.723 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.724 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.725 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.726 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.727 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.728 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.729 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.730 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.731 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.732 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.733 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35458 OpHistory root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.734 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.735 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.736 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.737 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.738 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.739 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.741 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.742 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.743 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.744 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35459 ceph_time root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.745 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.746 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.747 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.748 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.749 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.750 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.751 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.752 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.753 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.754 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.755 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35467 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.756 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.757 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.758 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.759 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.760 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.761 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.762 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.763 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.764 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.766 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.767 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35476 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.768 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.769 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.770 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.771 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.772 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.773 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.774 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.775 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.776 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.777 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.778 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.779 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35483 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.780 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.783 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.784 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.785 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.786 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.787 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.788 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.789 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.790 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35490 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.791 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.792 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.793 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.794 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.795 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.796 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.797 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.799 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.800 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.801 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.802 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35497 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.803 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.804 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.805 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.806 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.807 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.808 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.809 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.810 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.811 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.812 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.813 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35504 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.814 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.815 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.817 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.817 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.817 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.818 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.819 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.819 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.819 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.819 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.819 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.819 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.819 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.819 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.820 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.821 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.822 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.823 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.824 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.825 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.826 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.827 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.828 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35511 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.829 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.830 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.831 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.832 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.833 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.834 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.835 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.836 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.837 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.838 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.839 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35518 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.840 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.841 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.842 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.843 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.844 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.845 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.846 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.847 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.848 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.849 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.850 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35521 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.851 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.852 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.853 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.854 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.855 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.856 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.857 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.858 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.859 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.860 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.861 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.862 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35522 safe_time root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.863 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.863 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.863 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.863 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.863 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.863 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.863 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.863 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.863 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.864 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.865 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.866 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.867 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.868 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.869 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.870 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.871 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.872 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.873 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35523 safe_time root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.874 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.875 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.876 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.877 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.878 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.879 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.880 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.881 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.882 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.883 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.884 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35525 safe_time root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.885 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.886 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.887 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.888 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.889 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.890 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.891 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.892 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.893 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.894 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.895 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35527 safe_time root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.897 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.898 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.899 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.900 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.901 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.902 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.903 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.904 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.905 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.906 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35529 fn_anonym root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.907 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.908 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.909 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.910 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.911 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.912 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.914 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.915 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.916 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.917 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.918 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35555 rocksdb:l root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.919 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.920 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.921 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.922 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.923 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.924 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.925 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.926 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.927 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.928 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.929 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35556 rocksdb:l root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.930 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.931 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.932 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.933 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.934 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.935 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.936 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.937 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.938 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.939 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.940 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35557 rocksdb:l root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.941 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.942 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.943 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.944 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.945 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.946 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.947 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.948 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.949 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.950 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.951 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 35558 rocksdb:h root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.952 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.953 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.955 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.956 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.957 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.958 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.959 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.960 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.961 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.962 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37021 bstore_ai root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.963 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.964 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.965 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.966 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.967 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.968 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.969 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.970 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.971 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.972 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.973 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 37732 bstore_ai root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.974 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.975 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.976 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.977 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.978 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.979 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.980 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.981 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.982 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.983 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.984 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38475 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.985 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.986 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.987 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:40.988 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:40.990 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:40.991 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:40.992 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.993 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.994 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:40.995 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38478 cfin root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:40.996 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:40.997 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:40.998 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:40.999 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.000 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.001 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.002 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.003 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.004 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.005 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.006 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38479 bstore_kv root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.008 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.009 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.010 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.011 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.012 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.013 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.014 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.015 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.016 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.017 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.018 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38480 bstore_kv root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.019 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.020 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.021 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.022 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.023 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.024 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.025 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.026 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.027 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.028 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.029 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38482 bstore_me root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.030 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.031 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.032 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.033 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.034 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.035 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.036 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.037 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.038 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.039 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.040 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38501 ms_dispat root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.041 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.042 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.043 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.044 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.045 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.046 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.047 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.048 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.049 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.050 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.051 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.052 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38503 ms_local root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.053 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.054 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.055 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.056 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.057 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.058 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.059 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.060 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.061 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.062 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.063 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38506 safe_time root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.064 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.065 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.066 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.067 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.068 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.069 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.070 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.071 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.072 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.073 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.074 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.075 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38509 safe_time root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.076 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.077 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.078 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.079 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.080 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.081 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.082 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.083 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.084 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.085 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.086 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38514 ms_dispat root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.087 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.088 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.089 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.090 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.091 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.092 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.093 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.094 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.095 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.096 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.097 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38517 ms_local root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.098 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.099 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.100 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.101 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.102 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.103 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.104 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.105 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.106 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.107 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.108 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38519 ms_dispat root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.109 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.110 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.111 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.112 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.113 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.114 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.116 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.117 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.118 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.119 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38523 ms_local root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.120 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.121 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.122 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.123 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.124 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.125 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.126 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.127 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.128 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.129 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.130 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38525 ms_dispat root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.131 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.132 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.134 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.135 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.136 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.137 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.138 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.139 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.140 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.141 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38529 ms_local root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.142 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.143 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.144 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.145 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.146 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.147 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.148 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.149 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.150 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.151 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.152 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38533 ms_dispat root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.153 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.154 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.155 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.156 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.157 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.158 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.159 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.160 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.161 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.162 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.163 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38537 ms_local root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.164 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.165 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.167 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.168 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.169 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.170 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.171 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.172 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.173 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.174 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38542 ms_dispat root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.175 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.176 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.177 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.178 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.179 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.180 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.181 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.182 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.183 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.184 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.185 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38546 ms_local root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.186 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.187 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.188 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.189 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.190 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.191 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.192 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.193 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.194 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.195 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.196 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38550 ms_dispat root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.197 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.198 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.199 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.200 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.201 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.202 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.203 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.204 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.205 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.206 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.207 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.208 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38553 ms_local root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.209 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.210 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.211 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.212 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.213 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.214 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.215 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.216 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.217 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.218 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.219 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38556 fn_anonym root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.220 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.221 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.222 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.223 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.224 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.225 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.226 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.227 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.228 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.229 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.230 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38559 finisher root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.231 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.232 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.233 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.234 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.235 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.236 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.237 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.238 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.239 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.240 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.241 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38563 safe_time root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.242 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.243 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.244 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.245 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.246 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.247 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.248 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.249 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.250 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.251 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.252 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38567 safe_time root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.253 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.254 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.255 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.257 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.258 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.259 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.260 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.261 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.262 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.263 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38571 memcheck- root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.264 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.265 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.267 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.268 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.269 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.270 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.271 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.272 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.273 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.274 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38575 osd_srv_a root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.275 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.276 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.277 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.278 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.279 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.280 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.281 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.282 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.284 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.285 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38578 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.286 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.287 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.288 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.289 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.290 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.291 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.292 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.293 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.294 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.295 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.296 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38582 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.297 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.298 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.300 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.301 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.302 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.303 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.304 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.305 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.306 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.307 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38587 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.308 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.309 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.310 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.311 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.312 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.313 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.314 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.315 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.316 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.317 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.319 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.319 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.319 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.320 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38590 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.321 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.322 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.323 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.324 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.325 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.326 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.326 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.326 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.326 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.326 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.326 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.326 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.326 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.327 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.328 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.329 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.330 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.331 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38593 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.333 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.334 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.335 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.336 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.337 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.338 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.339 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.340 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.341 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.342 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.343 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38600 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.344 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.345 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.346 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.347 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.348 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.349 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.350 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.351 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.352 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.353 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.354 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.355 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38604 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.356 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.358 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.359 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.361 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.362 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.363 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.364 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.365 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.366 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38608 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.367 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.368 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.369 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.370 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.371 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.372 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.373 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.374 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.375 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.376 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.377 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38612 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.378 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.379 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.380 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.381 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.382 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.383 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.384 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.385 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.386 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.387 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.388 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.389 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38616 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.390 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.391 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.392 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.393 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.394 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.395 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.396 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.397 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.398 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.399 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.400 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38620 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.401 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.402 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.403 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.404 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.405 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.406 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.407 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.408 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.410 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.411 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38624 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.412 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.413 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.414 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.415 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.416 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.417 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.418 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.419 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.420 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.421 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.422 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38627 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.423 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.424 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.425 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.426 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.427 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.429 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.430 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.431 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.431 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.431 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.431 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.431 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.431 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.431 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.431 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.431 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.432 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.433 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.434 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.435 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.436 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.437 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38630 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.438 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.439 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.440 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.441 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.442 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.443 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.444 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.445 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.446 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.447 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.448 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.449 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.451 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38633 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.452 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.453 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.454 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.455 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.456 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.456 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.456 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.456 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.456 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.456 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.456 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.456 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.457 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.458 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.459 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.460 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.461 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.462 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.463 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.464 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.465 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.466 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38637 tp_osd_tp root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.467 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.468 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.468 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.468 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.468 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.468 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.468 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.468 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.468 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.468 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.469 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.470 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.471 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 15752 265731 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.472 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 32512 265710 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 37064 265695 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 409304 265719 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 70432 265713 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 69736 2313 /usr/lib64/liboath.so.0.1.3 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 70536 265689 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 36976 265743 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 41168 265686 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 74928 265683 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 86632 265740 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-04-15T15:31:41.473 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 45176 265737 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 864216 265722 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 208184 265692 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 1338672 265725 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 49416 265704 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 83008 265698 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 24336 265734 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 95312 265716 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 124744 265680 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 822000 265707 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-04-15T15:31:41.474 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 120512 265728 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 74496 265701 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root mem REG 8,1 48 2461 /tmp/vgdb-pipe-shared-mem-vgdb-35392-by-root-on-??? 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root DEL REG 0,17 118315 /[aio] 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root DEL REG 0,17 121025 /[aio] 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 1w FIFO 0,13 0t0 119884 pipe 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 2w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 3w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 4r FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 5w FIFO 0,13 0t0 116472 pipe 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 6u a_inode 0,14 0 1085 [eventpoll:7,20,21,22,23,57,112] 2024-04-15T15:31:41.475 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 7r FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 8w FIFO 0,13 0t0 120986 pipe 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 9u a_inode 0,14 0 1085 [eventpoll:10,55] 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 10r FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 11w FIFO 0,13 0t0 120987 pipe 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 12u a_inode 0,14 0 1085 [eventpoll:13,111] 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 13r FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 14w FIFO 0,13 0t0 120988 pipe 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 15w REG 8,1 584784746 267163 /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 16uW REG 0,24 6 2039 /run/ceph/ceph-osd.7.pid 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 17r FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 18w FIFO 0,13 0t0 118286 pipe 2024-04-15T15:31:41.476 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 19u unix 0xffff92a05a207300 0t0 118287 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 20u IPv4 118831 0t0 TCP *:6800 (LISTEN) 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 21u IPv4 116488 0t0 TCP *:acnet (LISTEN) 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 22u IPv4 116491 0t0 TCP *:6802 (LISTEN) 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 23u IPv4 116495 0t0 TCP *:6803 (LISTEN) 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 24r FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 25w FIFO 0,13 0t0 118294 pipe 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 26r FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 27w FIFO 0,13 0t0 118295 pipe 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 28u sock 0,8 0t0 119928 protocol: UDPv6 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 29r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 30uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 31u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.477 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 32u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 33u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.478 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 55u IPv4 136623 0t0 TCP smithi164.front.sepia.ceph.com:57064->smithi164.front.sepia.ceph.com:6811 (ESTABLISHED) 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 56r FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.479 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 57u IPv4 133091 0t0 TCP smithi164.front.sepia.ceph.com:34970->smithi164.front.sepia.ceph.com:6810 (ESTABLISHED) 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 58w FIFO 0,13 0t0 116506 pipe 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 59r FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 60w FIFO 0,13 0t0 116507 pipe 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 111u IPv4 133018 0t0 TCP smithi164.front.sepia.ceph.com:42306->smithi164.front.sepia.ceph.com:6800 (ESTABLISHED) 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root 112u IPv4 135527 0t0 TCP smithi164.front.sepia.ceph.com:6800->smithi164.front.sepia.ceph.com:42306 (ESTABLISHED) 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root *525u REG 8,1 32 26304 /tmp/valgrind_proc_35392_cmdline_f8d52232 (deleted) 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root *526u REG 8,1 336 26305 /tmp/valgrind_proc_35392_auxv_f8d52232 (deleted) 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root *527w FIFO 0,13 0t0 119885 pipe 2024-04-15T15:31:41.480 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root *528w REG 8,1 1234 655971 /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root *529r FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root *530w FIFO 0,13 0t0 116471 pipe 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35392 38642 osd_srv_h root *531r FIFO 8,1 0t0 26312 /tmp/vgdb-pipe-from-vgdb-to-35392-by-root-on-??? 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.481 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.482 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.483 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.484 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.485 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.485 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.485 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.485 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.485 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.485 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.485 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.486 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.486 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.486 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.486 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.486 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.486 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.486 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.486 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.486 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.487 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.488 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.489 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.490 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.491 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.492 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.493 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.494 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.495 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.496 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.497 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35398 log root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.498 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.499 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.500 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.501 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.502 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.503 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.504 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.505 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35412 msgr-work root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.506 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.507 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.508 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.509 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.510 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.511 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.512 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.513 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.514 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35413 msgr-work root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.515 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.516 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.518 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.519 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.520 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.521 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.522 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.523 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.523 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.523 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.523 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.523 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.523 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.523 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.523 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.523 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35415 msgr-work root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.524 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.525 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.526 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.527 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.528 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.529 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.530 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.530 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.530 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.530 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.530 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.530 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.530 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.531 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.532 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35431 service root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.533 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.534 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.536 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.537 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.538 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.539 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.540 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.540 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.540 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.540 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.540 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.540 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.540 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.540 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35432 admin_soc root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.541 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.542 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.543 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.543 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.543 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.543 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.543 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.543 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.543 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.543 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.543 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.544 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.545 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.546 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.546 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.546 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.546 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.546 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.546 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.546 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.546 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.547 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.548 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35449 signal_ha root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.549 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.550 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.551 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.552 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.553 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.554 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.555 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.556 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35450 io_contex root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.557 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.558 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.559 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.560 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.561 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.562 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.563 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.563 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.564 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35451 io_contex root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.565 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.566 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.568 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.569 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.570 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.571 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.572 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35466 ceph_time root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.573 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.574 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.575 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.576 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.577 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.578 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.579 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35524 memcheck- root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.580 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.581 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.582 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.583 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.584 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.585 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.586 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.587 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35559 rocksdb:l root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.588 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.589 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.590 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.591 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.592 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.593 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.594 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35560 rocksdb:l root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.595 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.596 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.597 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.598 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.599 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.600 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.601 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.602 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35561 rocksdb:l root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.603 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.604 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.605 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.605 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.605 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.605 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.605 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.605 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.605 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.605 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.606 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.607 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.608 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 35562 rocksdb:h root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.610 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.611 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.612 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.613 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.614 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.615 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.616 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38495 ms_dispat root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.617 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.618 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.619 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.620 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.621 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.622 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.623 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38496 ms_local root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.624 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.625 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.626 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.627 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.628 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.629 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.630 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38502 ms_dispat root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.631 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.632 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.633 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.634 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.635 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.636 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.637 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38504 ms_local root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.638 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.639 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.640 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.641 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.642 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.644 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.645 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38508 ms_dispat root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.646 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.647 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.648 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.649 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.650 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.651 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.652 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38511 ms_local root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.653 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.654 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.656 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.657 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.658 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.659 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38516 ms_dispat root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root cwd DIR 8,1 4096 262166 /home/ubuntu/cephtest 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.660 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 326760 2352 /usr/lib64/libtcmalloc.so.4.5.9 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 639224 2298 /usr/lib64/libthrift-0.15.0.so 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.661 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 61880 2342 /usr/lib64/libunwind.so.8.0.1 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.662 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.663 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 53272 2261 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 53816 1769 /usr/lib64/libnuma.so.1.0.0 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 74680 265676 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 357488 265666 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 1493776 265670 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 32664 265648 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root mem REG 8,1 48 26313 /tmp/vgdb-pipe-shared-mem-vgdb-35394-by-root-on-??? 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 1w FIFO 0,13 0t0 115499 pipe 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 2w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.664 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 3w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 4r FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 5w FIFO 0,13 0t0 118280 pipe 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 6u a_inode 0,14 0 1085 [eventpoll:7,22,23,61] 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 7r FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 8w FIFO 0,13 0t0 118283 pipe 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 9u a_inode 0,14 0 1085 [eventpoll:10] 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 10r FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 11w FIFO 0,13 0t0 118284 pipe 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 12u a_inode 0,14 0 1085 [eventpoll:13] 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 13r FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 14w FIFO 0,13 0t0 118285 pipe 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 15w REG 8,1 613706041 267162 /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 16uW REG 0,24 6 2043 /run/ceph/ceph-osd.6.pid 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 17r FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.665 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 18w FIFO 0,13 0t0 114280 pipe 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 19u unix 0xffff92a058853700 0t0 114281 /var/run/ceph/ceph-osd.6.asok type=STREAM (LISTEN) 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 22u IPv4 118861 0t0 TCP *:6810 (LISTEN) 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 23u IPv4 118873 0t0 TCP *:6811 (LISTEN) 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 24r FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 25w FIFO 0,13 0t0 114288 pipe 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 26r FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 27w FIFO 0,13 0t0 114289 pipe 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 28u sock 0,8 0t0 118310 protocol: UDPv6 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 55r FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 57w FIFO 0,13 0t0 117323 pipe 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 58r FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 59w FIFO 0,13 0t0 117324 pipe 2024-04-15T15:31:41.666 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root 61u IPv4 134696 0t0 TCP smithi164.front.sepia.ceph.com:6810->smithi164.front.sepia.ceph.com:36900 (CLOSE_WAIT) 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root *524r REG 8,1 25101544 2862 /usr/bin/ceph-osd 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root *525u REG 8,1 32 26308 /tmp/valgrind_proc_35394_cmdline_8e823958 (deleted) 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root *526u REG 8,1 336 26309 /tmp/valgrind_proc_35394_auxv_8e823958 (deleted) 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root *527w FIFO 0,13 0t0 115500 pipe 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root *528w REG 8,1 1234 655973 /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root *529r FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root *530w FIFO 0,13 0t0 118279 pipe 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:memcheck- 35394 38522 ms_local root *531r FIFO 8,1 0t0 26315 /tmp/vgdb-pipe-from-vgdb-to-35394-by-root-on-??? 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 38669 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 38669 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 38669 root txt unknown /proc/38669/exe 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root cwd DIR 8,1 4096 1136 /var/spool/anacron 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root txt REG 8,1 41136 11229 /usr/sbin/anacron 2024-04-15T15:31:41.667 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:41.668 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root 0r CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root 1w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root 2w CHR 1,3 0t0 4 /dev/null 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root 4u unix 0xffff92a50ebbb700 0t0 116541 type=DGRAM (CONNECTED) 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root 5uW REG 8,1 0 1139 /var/spool/anacron/cron.weekly 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:anacron 38702 root 6uW REG 8,1 0 1140 /var/spool/anacron/cron.monthly 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 38706 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 38706 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 38706 root txt unknown /proc/38706/exe 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 38707 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 38707 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 38707 root txt unknown /proc/38707/exe 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 38708 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.669 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 38708 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 38708 root txt unknown /proc/38708/exe 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 38729 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 38729 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 38729 root txt unknown /proc/38729/exe 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 38731 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 38731 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 38731 root txt unknown /proc/38731/exe 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 38737 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 38737 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/3 38737 root txt unknown /proc/38737/exe 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 38738 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 38738 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.670 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/4 38738 root txt unknown /proc/38738/exe 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 38741 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 38741 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/6 38741 root txt unknown /proc/38741/exe 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 38743 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 38743 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 38743 root txt unknown /proc/38743/exe 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 38746 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 38746 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/0 38746 root txt unknown /proc/38746/exe 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 38751 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 38751 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/u 38751 root txt unknown /proc/38751/exe 2024-04-15T15:31:41.671 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 38752 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 38752 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 38752 root txt unknown /proc/38752/exe 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 38753 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 38753 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/5 38753 root txt unknown /proc/38753/exe 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 38754 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 38754 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/7 38754 root txt unknown /proc/38754/exe 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 38755 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 38755 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/1 38755 root txt unknown /proc/38755/exe 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 38757 root cwd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 38757 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.672 INFO:teuthology.orchestra.run.smithi164.stdout:kworker/2 38757 root txt unknown /proc/38757/exe 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:41.673 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu 0r FIFO 0,13 0t0 136672 pipe 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu 1w FIFO 0,13 0t0 136673 pipe 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:bash 38834 ubuntu 2w FIFO 0,13 0t0 136674 pipe 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root cwd DIR 8,1 4096 1026 /home/ubuntu 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root txt REG 8,1 185296 11759 /usr/bin/sudo 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-04-15T15:31:41.674 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-04-15T15:31:41.675 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-04-15T15:31:41.676 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.676 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.676 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.676 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.677 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.677 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-04-15T15:31:41.677 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.678 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.679 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root 0r FIFO 0,13 0t0 136672 pipe 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root 1w FIFO 0,13 0t0 136673 pipe 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root 2w FIFO 0,13 0t0 136674 pipe 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root 3r FIFO 0,13 0t0 134719 pipe 2024-04-15T15:31:41.680 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root 4w FIFO 0,13 0t0 134719 pipe 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root 5u netlink 0t0 134725 AUDIT 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:sudo 38850 root 6u unix 0xffff92a50ddfa800 0t0 134726 type=DGRAM (CONNECTED) 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root cwd DIR 8,1 4096 1026 /home/ubuntu 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root txt REG 8,1 179232 12343 /usr/bin/lsof 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.681 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root 0r FIFO 0,13 0t0 136672 pipe 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root 1w FIFO 0,13 0t0 136673 pipe 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root 2w FIFO 0,13 0t0 136674 pipe 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root 3r DIR 0,20 0 1 /proc 2024-04-15T15:31:41.682 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root 4r DIR 0,20 0 135681 /proc/38852/fd 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root 5w FIFO 0,13 0t0 135686 pipe 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38852 root 6r FIFO 0,13 0t0 135687 pipe 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root cwd DIR 8,1 4096 1026 /home/ubuntu 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root rtd DIR 8,1 4096 2 / 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root txt REG 8,1 179232 12343 /usr/bin/lsof 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-04-15T15:31:41.683 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root 4r FIFO 0,13 0t0 135686 pipe 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:lsof 38853 root 7w FIFO 0,13 0t0 135687 pipe 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:root 2 0.0 0.0 0 0 ? S 14:40 0:00 [kthreadd] 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:root 3 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [rcu_gp] 2024-04-15T15:31:41.684 INFO:teuthology.orchestra.run.smithi164.stdout:root 4 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [rcu_par_gp] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 5 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [slub_flushwq] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 6 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [netns] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 8 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/0:0H-events_highpri] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 9 0.0 0.0 0 0 ? I 14:40 0:00 \_ [kworker/u16:0-writeback] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 10 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [mm_percpu_wq] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 12 0.0 0.0 0 0 ? I 14:40 0:00 \_ [rcu_tasks_kthre] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 13 0.0 0.0 0 0 ? I 14:40 0:00 \_ [rcu_tasks_rude_] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 14 0.0 0.0 0 0 ? I 14:40 0:00 \_ [rcu_tasks_trace] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 15 0.0 0.0 0 0 ? S 14:40 0:00 \_ [ksoftirqd/0] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 16 0.1 0.0 0 0 ? S 14:40 0:05 \_ [pr/ttyS1] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 17 0.0 0.0 0 0 ? I 14:40 0:00 \_ [rcu_preempt] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 18 0.0 0.0 0 0 ? S 14:40 0:00 \_ [migration/0] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 19 0.0 0.0 0 0 ? S 14:40 0:00 \_ [idle_inject/0] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 21 0.0 0.0 0 0 ? S 14:40 0:00 \_ [cpuhp/0] 2024-04-15T15:31:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:root 22 0.0 0.0 0 0 ? S 14:40 0:00 \_ [cpuhp/1] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 23 0.0 0.0 0 0 ? S 14:40 0:00 \_ [idle_inject/1] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 24 0.0 0.0 0 0 ? S 14:40 0:00 \_ [migration/1] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 25 0.0 0.0 0 0 ? S 14:40 0:00 \_ [ksoftirqd/1] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 27 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/1:0H-events_highpri] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 28 0.0 0.0 0 0 ? S 14:40 0:00 \_ [cpuhp/2] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 29 0.0 0.0 0 0 ? S 14:40 0:00 \_ [idle_inject/2] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 30 0.0 0.0 0 0 ? S 14:40 0:00 \_ [migration/2] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 31 0.0 0.0 0 0 ? S 14:40 0:00 \_ [ksoftirqd/2] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 33 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/2:0H-events_highpri] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 34 0.0 0.0 0 0 ? S 14:40 0:00 \_ [cpuhp/3] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 35 0.0 0.0 0 0 ? S 14:40 0:00 \_ [idle_inject/3] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 36 0.0 0.0 0 0 ? S 14:40 0:00 \_ [migration/3] 2024-04-15T15:31:41.686 INFO:teuthology.orchestra.run.smithi164.stdout:root 37 0.0 0.0 0 0 ? S 14:40 0:00 \_ [ksoftirqd/3] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 39 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/3:0H-events_highpri] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 40 0.0 0.0 0 0 ? S 14:40 0:00 \_ [cpuhp/4] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 41 0.0 0.0 0 0 ? S 14:40 0:00 \_ [idle_inject/4] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 42 0.0 0.0 0 0 ? S 14:40 0:00 \_ [migration/4] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 43 0.0 0.0 0 0 ? S 14:40 0:00 \_ [ksoftirqd/4] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 45 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/4:0H-events_highpri] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 46 0.0 0.0 0 0 ? S 14:40 0:00 \_ [cpuhp/5] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 47 0.0 0.0 0 0 ? S 14:40 0:00 \_ [idle_inject/5] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 48 0.0 0.0 0 0 ? S 14:40 0:00 \_ [migration/5] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 49 0.0 0.0 0 0 ? S 14:40 0:00 \_ [ksoftirqd/5] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 51 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/5:0H-events_highpri] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 52 0.0 0.0 0 0 ? S 14:40 0:00 \_ [cpuhp/6] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 53 0.0 0.0 0 0 ? S 14:40 0:00 \_ [idle_inject/6] 2024-04-15T15:31:41.687 INFO:teuthology.orchestra.run.smithi164.stdout:root 54 0.0 0.0 0 0 ? S 14:40 0:00 \_ [migration/6] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 55 0.0 0.0 0 0 ? S 14:40 0:00 \_ [ksoftirqd/6] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 57 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/6:0H-events_highpri] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 58 0.0 0.0 0 0 ? S 14:40 0:00 \_ [cpuhp/7] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 59 0.0 0.0 0 0 ? S 14:40 0:00 \_ [idle_inject/7] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 60 0.0 0.0 0 0 ? S 14:40 0:00 \_ [migration/7] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 61 0.0 0.0 0 0 ? S 14:40 0:00 \_ [ksoftirqd/7] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 63 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/7:0H-events_highpri] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 70 0.0 0.0 0 0 ? I 14:40 0:01 \_ [kworker/u16:7-events_unbound] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 71 0.0 0.0 0 0 ? S 14:40 0:00 \_ [kdevtmpfs] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 72 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [inet_frag_wq] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 73 0.0 0.0 0 0 ? S 14:40 0:00 \_ [kauditd] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 75 0.0 0.0 0 0 ? S 14:40 0:00 \_ [khungtaskd] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 76 0.0 0.0 0 0 ? S 14:40 0:00 \_ [oom_reaper] 2024-04-15T15:31:41.688 INFO:teuthology.orchestra.run.smithi164.stdout:root 77 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [writeback] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 78 0.0 0.0 0 0 ? S 14:40 0:00 \_ [kcompactd0] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 79 0.0 0.0 0 0 ? SN 14:40 0:00 \_ [ksmd] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 80 0.0 0.0 0 0 ? SN 14:40 0:00 \_ [khugepaged] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 81 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [cryptd] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 82 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kintegrityd] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 83 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kblockd] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 84 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [blkcg_punt_bio] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 85 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [tpm_dev_wq] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 86 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [md] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 87 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [md_bitmap] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 88 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [edac-poller] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 89 0.0 0.0 0 0 ? S 14:40 0:00 \_ [watchdogd] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 91 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/6:1H-xfs-log/dm-2] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 93 0.0 0.0 0 0 ? S 14:40 0:00 \_ [kswapd0] 2024-04-15T15:31:41.689 INFO:teuthology.orchestra.run.smithi164.stdout:root 99 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kthrotld] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 109 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [acpi_thermal_pm] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 110 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kmpath_rdacd] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 111 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kaluad] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 112 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [mld] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 113 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [ipv6_addrconf] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 125 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kstrp] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 131 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [zswap-shrink] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 132 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/u17:0] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 239 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/1:1H-xfs-log/dm-0] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 278 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/2:1H-kblockd] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 281 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/7:1H-xfs-log/dm-4] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 282 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/5:1H-kblockd] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 284 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/0:1H-kblockd] 2024-04-15T15:31:41.690 INFO:teuthology.orchestra.run.smithi164.stdout:root 288 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/3:1H-kblockd] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 289 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [kworker/4:1H-kblockd] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 432 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [nvme-wq] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 433 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [nvme-reset-wq] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 437 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [nvme-delete-wq] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 438 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [nvme-auth-wq] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 441 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [ata_sff] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 444 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [ixgbe] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 451 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_0] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 452 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_0] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 453 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_1] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 454 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_1] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 455 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_2] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 456 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_2] 2024-04-15T15:31:41.691 INFO:teuthology.orchestra.run.smithi164.stdout:root 457 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_3] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 458 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_3] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 459 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_4] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 460 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_4] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 461 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_5] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 462 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_5] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 463 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_6] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 464 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_6] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 465 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_7] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 466 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_7] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 467 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_8] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 468 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_8] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 469 0.0 0.0 0 0 ? S 14:40 0:00 \_ [scsi_eh_9] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 470 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [scsi_tmf_9] 2024-04-15T15:31:41.692 INFO:teuthology.orchestra.run.smithi164.stdout:root 499 0.0 0.0 0 0 ? S 14:40 0:00 \_ [jbd2/sda1-8] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 500 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [ext4-rsv-conver] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 581 0.0 0.0 0 0 ? S 14:40 0:00 \_ [ext4lazyinit] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 635 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [ipmi-msghandler] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 644 0.0 0.0 0 0 ? SN 14:40 0:00 \_ [kipmi0] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 666 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [rpciod] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 667 0.0 0.0 0 0 ? I< 14:40 0:00 \_ [xprtiod] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 15856 0.0 0.0 0 0 ? I< 14:44 0:00 \_ [tls-strp] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 21262 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [kdmflush/253:0] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 21291 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [kdmflush/253:1] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 21320 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [kdmflush/253:2] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 21349 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [kdmflush/253:3] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 21378 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [kdmflush/253:4] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 21542 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [xfsalloc] 2024-04-15T15:31:41.693 INFO:teuthology.orchestra.run.smithi164.stdout:root 21543 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [xfs_mru_cache] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 21544 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [xfs-buf/dm-4] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 21545 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [xfs-conv/dm-4] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 21546 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [xfs-reclaim/dm-] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 21547 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [xfs-blockgc/dm-] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 21548 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [xfs-inodegc/dm-] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 21549 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [xfs-log/dm-4] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 21550 0.0 0.0 0 0 ? I< 14:45 0:00 \_ [xfs-cil/dm-4] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 21551 0.0 0.0 0 0 ? S 14:45 0:00 \_ [xfsaild/dm-4] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 25268 0.0 0.0 0 0 ? I 14:47 0:00 \_ [kworker/4:0-dio/dm-2] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 26219 0.0 0.0 0 0 ? I 14:47 0:00 \_ [kworker/5:34-mm_percpu_wq] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 28313 0.0 0.0 0 0 ? I 14:48 0:00 \_ [kworker/6:3-events] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 29668 0.0 0.0 0 0 ? I< 14:58 0:00 \_ [xfs-buf/dm-3] 2024-04-15T15:31:41.694 INFO:teuthology.orchestra.run.smithi164.stdout:root 29669 0.0 0.0 0 0 ? I< 14:58 0:00 \_ [xfs-conv/dm-3] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 29670 0.0 0.0 0 0 ? I< 14:58 0:00 \_ [xfs-reclaim/dm-] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 29671 0.0 0.0 0 0 ? I< 14:58 0:00 \_ [xfs-blockgc/dm-] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 29672 0.0 0.0 0 0 ? I< 14:58 0:00 \_ [xfs-inodegc/dm-] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 29673 0.0 0.0 0 0 ? I< 14:58 0:00 \_ [xfs-log/dm-3] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 29674 0.0 0.0 0 0 ? I< 14:58 0:00 \_ [xfs-cil/dm-3] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 29675 0.0 0.0 0 0 ? S 14:58 0:00 \_ [xfsaild/dm-3] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 33207 0.0 0.0 0 0 ? I< 14:58 0:00 \_ [dio/dm-3] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 38669 0.0 0.0 0 0 ? I 14:59 0:00 \_ [kworker/2:2-cgroup_destroy] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 38706 0.0 0.0 0 0 ? I 15:05 0:00 \_ [kworker/u16:1-flush-8:0] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 38707 0.0 0.0 0 0 ? I 15:06 0:00 \_ [kworker/0:0-mm_percpu_wq] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 38708 0.0 0.0 0 0 ? I 15:07 0:00 \_ [kworker/7:0-mm_percpu_wq] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 38729 0.0 0.0 0 0 ? I 15:11 0:00 \_ [kworker/1:3-mm_percpu_wq] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 38731 0.0 0.0 0 0 ? I 15:11 0:00 \_ [kworker/3:1-mm_percpu_wq] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 38737 0.0 0.0 0 0 ? I 15:11 0:00 \_ [kworker/3:4-dio/dm-2] 2024-04-15T15:31:41.695 INFO:teuthology.orchestra.run.smithi164.stdout:root 38738 0.0 0.0 0 0 ? I 15:11 0:00 \_ [kworker/4:2-events] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 38741 0.0 0.0 0 0 ? I 15:11 0:00 \_ [kworker/6:4-dio/dm-2] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 38743 0.0 0.0 0 0 ? I 15:15 0:00 \_ [kworker/u16:3-flush-8:0] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 38746 0.0 0.0 0 0 ? I 15:18 0:00 \_ [kworker/0:1-events] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 38751 0.0 0.0 0 0 ? I 15:23 0:00 \_ [kworker/u16:4-flush-8:0] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 38752 0.0 0.0 0 0 ? I 15:23 0:00 \_ [kworker/2:0-events] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 38753 0.0 0.0 0 0 ? I 15:24 0:00 \_ [kworker/5:0-events] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 38754 0.0 0.0 0 0 ? I 15:25 0:00 \_ [kworker/7:2-events_freezable] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 38755 0.0 0.0 0 0 ? I 15:26 0:00 \_ [kworker/1:1-events] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 38757 0.0 0.0 0 0 ? I 15:30 0:00 \_ [kworker/2:1-events] 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 1 0.1 0.0 175172 19260 ? Ss 14:40 0:03 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 575 0.0 0.0 26816 14848 ? Ss 14:40 0:00 /usr/lib/systemd/systemd-journald 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:root 593 0.0 0.0 37156 15088 ? Ss 14:40 0:00 /usr/lib/systemd/systemd-udevd 2024-04-15T15:31:41.696 INFO:teuthology.orchestra.run.smithi164.stdout:rpc 664 0.0 0.0 13244 5248 ? Ss 14:40 0:00 /usr/bin/rpcbind -w -f 2024-04-15T15:31:41.697 INFO:teuthology.orchestra.run.smithi164.stdout:root 671 0.0 0.0 91908 4524 ? S, line 50) 2024-04-15T15:31:42.234 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 50, column 1 (, line 50) 2024-04-15T15:31:42.236 INFO:tasks.ceph:Archiving crash dumps... 2024-04-15T15:31:42.238 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826/remote/smithi038/crash 2024-04-15T15:31:42.239 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T15:31:42.286 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826/remote/smithi164/crash 2024-04-15T15:31:42.287 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T15:31:42.328 INFO:tasks.ceph:Compressing logs... 2024-04-15T15:31:42.328 DEBUG:teuthology.orchestra.run.smithi038:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T15:31:42.332 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T15:31:42.360 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41731.log 2024-04-15T15:31:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64311.log 2024-04-15T15:31:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41990.log 2024-04-15T15:31:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.64311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39634.log 2024-04-15T15:31:42.362 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41990.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-15T15:31:42.362 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39925.log 2024-04-15T15:31:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39634.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108655.log 2024-04-15T15:31:42.363 INFO:teuthology.orchestra.run.smithi038.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39634.log.gz 2024-04-15T15:31:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40917.log 2024-04-15T15:31:42.390 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108655.log: 85.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2024-04-15T15:31:42.390 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39925.log.gz 2024-04-15T15:31:42.390 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40917.log: 90.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40311.log 2024-04-15T15:31:42.390 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64311.log.gz 2024-04-15T15:31:42.390 INFO:teuthology.orchestra.run.smithi038.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108655.log.gz 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.41731.log.gz 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39929.log 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42036.log 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40311.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108781.log 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.40311.log.gz 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.39929.log.gz 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41399.log 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39627.log 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108781.log: /var/log/ceph/ceph-client.admin.41399.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.108781.log.gz 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39627.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/valgrind/mon.c.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.39627.log.gz 2024-04-15T15:31:42.391 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr: /var/log/ceph/valgrind/osd.0.log 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/valgrind/osd.2.log: 64.0% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/valgrind/osd.0.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.41399.log.gz 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr: 64.0%gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose 69.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr: -- /var/log/ceph/ceph-client.admin.41222.log 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40349.log 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108823.log 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108571.log 2024-04-15T15:31:42.392 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108823.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.40349.log.gzgzip 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59340.log 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.108823.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40961.log 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108571.log: /var/log/ceph/ceph-client.admin.59340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39628.log 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40961.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108571.log.gz 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41700.log 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39628.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.41990.log.gz 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39628.log.gz 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.59340.log.gz 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35255.log 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr:gzip/var/log/ceph/ceph-client.admin.41700.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40020.log 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.35255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41360.log 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40020.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.35255.log.gz 2024-04-15T15:31:42.393 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35638.log 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr: 86.2%/var/log/ceph/ceph-client.admin.41360.log: -- replaced with /var/log/ceph/ceph-client.admin.40020.log.gz 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39626.log 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.40961.log.gz 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.35638.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.41700.log.gz 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.41222.log.gz 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.35638.log.gz 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64312.log 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108613.log 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39626.log: /var/log/ceph/ceph-client.admin.64312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41916.log 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr: 90.5% 86.9% -- replaced with /var/log/ceph/ceph-client.admin.39626.log.gz 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42036.log.gz 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36641.log 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41916.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108613.log.gz 2024-04-15T15:31:42.394 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35557.log 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.36641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41332.log 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.40917.log.gz 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.35557.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36641.log.gz 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39952.log 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.64312.log.gz 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35557.log.gz 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41780.log 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42050.log 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41780.log: gzip -5 --verbose -- 86.3% /var/log/ceph/ceph-client.admin.59339.log 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39952.log.gz 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42050.log: gzip -5 91.3% -- replaced with /var/log/ceph/ceph-client.admin.41360.log.gz 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43355.log 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.59339.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41780.log.gz 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41855.log 2024-04-15T15:31:42.395 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41938.log 2024-04-15T15:31:42.396 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41855.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-15T15:31:42.396 INFO:teuthology.orchestra.run.smithi038.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.43355.log.gz/var/log/ceph/ceph-client.admin.41938.log: 2024-04-15T15:31:42.396 INFO:teuthology.orchestra.run.smithi038.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.41332.log.gz 2024-04-15T15:31:42.396 INFO:teuthology.orchestra.run.smithi038.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.59339.log.gz 2024-04-15T15:31:42.396 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108403.log 2024-04-15T15:31:42.396 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41384.log 2024-04-15T15:31:42.396 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64313.log 2024-04-15T15:31:42.396 INFO:teuthology.orchestra.run.smithi038.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.108403.log.gz 2024-04-15T15:31:42.396 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40460.log 2024-04-15T15:31:42.416 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.64313.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.64313.log.gz 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39410.log 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40460.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40460.log.gz 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108949.log 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39410.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.39410.log.gz 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54421.log 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108949.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108949.log.gz 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39629.log 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.41855.log.gz/var/log/ceph/ceph-client.admin.54421.log: 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42029.log 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39629.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41384.log.gz 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41454.log 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.39629.log.gz 2024-04-15T15:31:42.417 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108991.log 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41454.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.54421.log.gz 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41701.log 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41454.log.gz/var/log/ceph/ceph-client.admin.108991.log: 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.41121.log 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108991.log.gz 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39326.log 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41121.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41701.log.gz 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43354.log 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39326.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39326.log.gz 95.4% 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41352.log 2024-04-15T15:31:42.418 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40939.log 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41352.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43354.log.gz 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40939.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.40939.log.gz 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr: 90.7% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.42029.log.gz 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41352.log.gz 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39368.log 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41261.log 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41185.log 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39368.log.gz 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41261.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.41938.log.gz 2024-04-15T15:31:42.419 INFO:teuthology.orchestra.run.smithi038.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.41916.log.gz 2024-04-15T15:31:42.421 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-15T15:31:42.421 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35001.log 2024-04-15T15:31:42.421 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2024-04-15T15:31:42.421 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35001.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2024-04-15T15:31:42.421 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/valgrind/osd.7.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35001.log.gz 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr: 55.0% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/valgrind/osd.5.log: 64.0% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr: 55.1% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35292.log 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr: 69.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35041.log 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35292.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35041.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.35292.log.gz 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35081.log 2024-04-15T15:31:42.422 INFO:teuthology.orchestra.run.smithi164.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35041.log.gz 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.35081.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35081.log.gz 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35161.log 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35201.log 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35161.log.gz 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35241.log 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35201.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35201.log.gz 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35241.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35241.log.gz 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35121.log 2024-04-15T15:31:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-15T15:31:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.35121.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35121.log.gz 2024-04-15T15:31:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.b.log: 92.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-15T15:31:42.424 INFO:teuthology.orchestra.run.smithi164.stderr: 87.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-15T15:31:42.425 INFO:teuthology.orchestra.run.smithi038.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.41261.log.gz 2024-04-15T15:31:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45735.log 2024-04-15T15:31:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59336.log 2024-04-15T15:31:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39286.log 2024-04-15T15:31:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40314.log 2024-04-15T15:31:42.425 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.59336.log: /var/log/ceph/ceph-client.admin.39286.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39286.log.gz 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.59336.log.gz 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.45735.log.gz 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40969.log 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39452.log 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40969.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.40314.log.gz 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39180.log 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42003.log 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39180.log: /var/log/ceph/ceph-client.admin.39452.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39452.log.gz 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.39180.log.gz 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54423.log 2024-04-15T15:31:42.429 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59338.log 2024-04-15T15:31:42.430 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42003.log: /var/log/ceph/ceph-client.admin.54423.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.41185.log.gz 2024-04-15T15:31:42.430 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41085.log 2024-04-15T15:31:42.432 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.59338.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.40969.log.gz 2024-04-15T15:31:42.432 INFO:teuthology.orchestra.run.smithi038.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.42050.log.gz 2024-04-15T15:31:42.432 INFO:teuthology.orchestra.run.smithi038.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42003.log.gz 2024-04-15T15:31:42.433 INFO:teuthology.orchestra.run.smithi038.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.54423.log.gz 2024-04-15T15:31:42.433 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39632.log 2024-04-15T15:31:42.434 INFO:teuthology.orchestra.run.smithi164.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41734.log 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.59338.log.gz 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41734.log: 86.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41201.log 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39632.log.gz 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109033.log 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39623.log 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.109033.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109033.log.gz 2024-04-15T15:31:42.437 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-15T15:31:42.438 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41215.log 2024-04-15T15:31:42.438 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39623.log: /var/log/ceph/ceph-osd.3.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39623.log.gz 2024-04-15T15:31:42.438 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109075.log 2024-04-15T15:31:42.440 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41215.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.41201.log.gz 2024-04-15T15:31:42.440 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108529.log 2024-04-15T15:31:42.442 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.109075.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.109075.log.gz 2024-04-15T15:31:42.442 INFO:teuthology.orchestra.run.smithi038.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.41734.log.gz 2024-04-15T15:31:42.443 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40226.log 2024-04-15T15:31:42.443 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40206.log 2024-04-15T15:31:42.443 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40226.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108529.log.gz 2024-04-15T15:31:42.444 INFO:teuthology.orchestra.run.smithi038.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40226.log.gz 2024-04-15T15:31:42.444 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40881.log 2024-04-15T15:31:42.444 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108907.log 2024-04-15T15:31:42.444 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40206.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.41215.log.gz 2024-04-15T15:31:42.444 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39631.log 2024-04-15T15:31:42.445 INFO:teuthology.orchestra.run.smithi038.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.40206.log.gz 2024-04-15T15:31:42.445 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40865.log 2024-04-15T15:31:42.445 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39631.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108907.log.gz 2024-04-15T15:31:42.446 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41191.log 2024-04-15T15:31:42.446 INFO:teuthology.orchestra.run.smithi038.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.39631.log.gz 2024-04-15T15:31:42.447 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40865.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-15T15:31:42.459 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108487.log 2024-04-15T15:31:42.466 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40545.log 2024-04-15T15:31:42.467 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108487.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108487.log.gz 2024-04-15T15:31:42.473 INFO:teuthology.orchestra.run.smithi038.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.41191.log.gz 2024-04-15T15:31:42.474 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108445.log 2024-04-15T15:31:42.475 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40545.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40545.log.gz 2024-04-15T15:31:42.478 INFO:teuthology.orchestra.run.smithi038.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40865.log.gz 2024-04-15T15:31:42.478 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108865.log 2024-04-15T15:31:42.480 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108445.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.108445.log.gz 2024-04-15T15:31:42.480 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108739.log 2024-04-15T15:31:42.481 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108865.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.108865.log.gz 2024-04-15T15:31:42.481 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43356.log 2024-04-15T15:31:42.482 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108739.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108739.log.gz 2024-04-15T15:31:42.482 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108319.log 2024-04-15T15:31:42.487 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43356.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.43356.log.gz 2024-04-15T15:31:42.487 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39230.log 2024-04-15T15:31:42.487 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108319.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.108319.log.gz 2024-04-15T15:31:42.487 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-15T15:31:42.488 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39230.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39230.log.gz 2024-04-15T15:31:42.488 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41424.log 2024-04-15T15:31:42.499 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39924.log 2024-04-15T15:31:42.502 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41424.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40881.log.gz 2024-04-15T15:31:42.504 INFO:teuthology.orchestra.run.smithi038.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.41424.log.gz 2024-04-15T15:31:42.513 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41718.log 2024-04-15T15:31:42.515 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39924.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.39924.log.gz 2024-04-15T15:31:42.515 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41746.log 2024-04-15T15:31:42.515 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41718.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41718.log.gz 2024-04-15T15:31:42.516 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39855.log 2024-04-15T15:31:42.521 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41746.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.41746.log.gz 2024-04-15T15:31:42.521 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29448.log 2024-04-15T15:31:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39855.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.39855.log.gz 2024-04-15T15:31:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41745.log 2024-04-15T15:31:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.tmp-client.admin.29448.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29448.log.gz 2024-04-15T15:31:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43240.log 2024-04-15T15:31:42.526 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41745.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.41745.log.gz 2024-04-15T15:31:42.527 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38895.log 2024-04-15T15:31:42.531 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.43240.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43240.log.gz 2024-04-15T15:31:42.532 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2024-04-15T15:31:42.533 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.38895.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.38895.log.gz 2024-04-15T15:31:42.533 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108697.log 2024-04-15T15:31:42.535 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45737.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2024-04-15T15:31:42.536 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41733.log 2024-04-15T15:31:42.537 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108697.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.108697.log.gz 2024-04-15T15:31:42.538 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40502.log 2024-04-15T15:31:42.538 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41733.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41733.log.gz 2024-04-15T15:31:42.539 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40166.log 2024-04-15T15:31:42.540 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40502.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40502.log.gz 2024-04-15T15:31:42.540 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-15T15:31:42.542 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40166.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40166.log.gz 2024-04-15T15:31:42.542 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-15T15:31:42.554 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37731.log 2024-04-15T15:31:42.565 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-osd.2.log: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-15T15:31:42.569 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39104.log 2024-04-15T15:31:42.569 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.37731.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37731.log.gz 2024-04-15T15:31:42.587 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41801.log 2024-04-15T15:31:42.588 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39104.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39104.log.gz 2024-04-15T15:31:42.596 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41738.log 2024-04-15T15:31:42.607 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54422.log 2024-04-15T15:31:42.610 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41738.log: 90.9% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.41801.log.gz 2024-04-15T15:31:42.616 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108235.log 2024-04-15T15:31:42.623 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.54422.log: -- replaced with /var/log/ceph/ceph-client.admin.41738.log.gz 2024-04-15T15:31:42.623 INFO:teuthology.orchestra.run.smithi038.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.54422.log.gz 2024-04-15T15:31:42.630 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109117.log 2024-04-15T15:31:42.631 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108235.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.108235.log.gz 2024-04-15T15:31:42.640 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.109117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40313.log 2024-04-15T15:31:42.641 INFO:teuthology.orchestra.run.smithi038.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109117.log.gz 2024-04-15T15:31:42.653 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-04-15T15:31:42.654 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40313.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.40313.log.gz 2024-04-15T15:31:42.662 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40957.log 2024-04-15T15:31:42.675 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39914.log 2024-04-15T15:31:42.683 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108361.log 2024-04-15T15:31:42.692 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.39914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45736.log 2024-04-15T15:31:42.696 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108361.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.39914.log.gz 2024-04-15T15:31:42.705 INFO:teuthology.orchestra.run.smithi038.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108361.log.gz 2024-04-15T15:31:42.714 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109157.log 2024-04-15T15:31:42.717 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.45736.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45736.log.gz 2024-04-15T15:31:42.727 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108277.log 2024-04-15T15:31:42.728 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.109157.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109157.log.gz 2024-04-15T15:31:42.740 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35800.log 2024-04-15T15:31:42.741 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.108277.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.108277.log.gz 2024-04-15T15:31:42.754 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41473.log 2024-04-15T15:31:42.755 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.35800.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35800.log.gz 2024-04-15T15:31:42.761 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40902.log 2024-04-15T15:31:42.776 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.41473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59337.log 2024-04-15T15:31:42.783 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.40902.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.40902.log.gz 2024-04-15T15:31:42.783 INFO:teuthology.orchestra.run.smithi038.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-04-15T15:31:42.788 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42053.log 2024-04-15T15:31:42.790 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.59337.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.59337.log.gz 2024-04-15T15:31:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-15T15:31:42.805 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-client.admin.42053.log: 92.5% 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42053.log.gz 2024-04-15T15:31:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:/var/log/ceph/ceph-mon.c.log: -- replaced with /var/log/ceph/ceph-client.admin.40957.log.gz 2024-04-15T15:31:42.854 INFO:teuthology.orchestra.run.smithi038.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.41473.log.gz 2024-04-15T15:31:42.888 INFO:teuthology.orchestra.run.smithi038.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-15T15:31:42.962 INFO:teuthology.orchestra.run.smithi038.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.41121.log.gz 2024-04-15T15:31:43.810 INFO:teuthology.orchestra.run.smithi038.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.41085.log.gz 2024-04-15T15:31:43.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-15T15:31:44.417 INFO:teuthology.orchestra.run.smithi164.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-15T15:31:45.168 INFO:teuthology.orchestra.run.smithi038.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-15T15:31:47.561 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/ceph-osd.6.log: file size changed while zipping 2024-04-15T15:31:47.567 INFO:teuthology.orchestra.run.smithi038.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-15T15:31:47.630 INFO:teuthology.orchestra.run.smithi164.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-15T15:31:47.654 INFO:teuthology.orchestra.run.smithi038.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-15T15:31:47.995 INFO:teuthology.orchestra.run.smithi038.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-15T15:31:48.087 INFO:teuthology.orchestra.run.smithi164.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-15T15:31:48.420 INFO:teuthology.orchestra.run.smithi038.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-15T15:31:49.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-15T15:31:49.082 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/ceph-osd.7.log: file size changed while zipping 2024-04-15T15:31:49.083 INFO:teuthology.orchestra.run.smithi164.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-15T15:31:49.259 INFO:teuthology.orchestra.run.smithi038.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-15T15:31:49.261 INFO:teuthology.orchestra.run.smithi038.stderr: 2024-04-15T15:31:49.261 INFO:teuthology.orchestra.run.smithi038.stderr:real 0m6.916s 2024-04-15T15:31:49.261 INFO:teuthology.orchestra.run.smithi038.stderr:user 0m32.715s 2024-04-15T15:31:49.261 INFO:teuthology.orchestra.run.smithi038.stderr:sys 0m1.100s 2024-04-15T15:31:49.672 INFO:teuthology.orchestra.run.smithi164.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-15T15:31:49.674 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-15T15:31:49.674 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m7.285s 2024-04-15T15:31:49.674 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m26.137s 2024-04-15T15:31:49.674 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.746s 2024-04-15T15:31:49.674 INFO:tasks.ceph:Archiving logs... 2024-04-15T15:31:49.674 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826/remote/smithi038/log 2024-04-15T15:31:49.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T15:31:54.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2024-04-15T15:31:54.251 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826/remote/smithi164/log 2024-04-15T15:31:54.252 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T15:31:57.977 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1112, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1181, in cluster raise e File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1163, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi164 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-04-15T15:31:57.978 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-15T15:31:57.988 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1112, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1181, in cluster raise e File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1163, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi164 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-04-15T15:31:57.989 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-15T15:31:57.989 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T15:31:57.993 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T15:31:58.093 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-15T15:31:58.102 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-15T15:31:58.102 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T15:31:58.105 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T15:31:58.119 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-04-15T15:31:58.121 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-15T15:31:58.128 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T15:31:58.128 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-15T15:31:58.128 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +1550us[+1549us] +/- 48ms 2024-04-15T15:31:58.128 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -1570us[-1570us] +/- 62ms 2024-04-15T15:31:58.129 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 -615us[ -615us] +/- 86ms 2024-04-15T15:31:58.129 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T15:31:58.129 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T15:31:58.129 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-04-15T15:31:58.129 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +1554us[+1552us] +/- 48ms 2024-04-15T15:31:58.129 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -1548us[-1548us] +/- 62ms 2024-04-15T15:31:58.129 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 -579us[ -582us] +/- 86ms 2024-04-15T15:31:58.129 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T15:31:58.129 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-15T15:31:58.141 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-15T15:31:58.141 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-15T15:31:58.150 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T15:31:58.246 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T15:31:58.322 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T15:31:58.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:31:58.355 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T15:31:58.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:31:58.388 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-15T15:31:58.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-15T15:31:58.412 INFO:teuthology.task.internal:Duration was 3015.818111 seconds 2024-04-15T15:31:58.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-15T15:31:58.427 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-15T15:31:58.427 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T15:31:58.430 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T15:31:58.476 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T15:31:58.477 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T15:31:58.723 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-15T15:31:58.723 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2024-04-15T15:31:58.723 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T15:31:58.744 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-04-15T15:31:58.745 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T15:31:58.771 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-15T15:31:58.771 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T15:31:58.788 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T15:31:58.841 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-15T15:31:58.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T15:31:58.860 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T15:31:58.984 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-15T15:31:58.994 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-15T15:31:58.994 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T15:31:59.023 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T15:31:59.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-15T15:31:59.064 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T15:31:59.066 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T15:31:59.090 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2024-04-15T15:31:59.119 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-04-15T15:31:59.145 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T15:31:59.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:31:59.162 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T15:31:59.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:31:59.200 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-15T15:31:59.210 INFO:teuthology.task.internal:Transferring archived files... 2024-04-15T15:31:59.211 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826/remote/smithi038 2024-04-15T15:31:59.211 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T15:31:59.275 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826/remote/smithi164 2024-04-15T15:31:59.275 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T15:31:59.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~10s 2024-04-15T15:31:59.312 INFO:teuthology.task.internal:Removing archive directory... 2024-04-15T15:31:59.313 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T15:31:59.315 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T15:31:59.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-15T15:31:59.376 INFO:teuthology.task.internal:Not uploading archives. 2024-04-15T15:31:59.376 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-15T15:31:59.386 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-15T15:31:59.387 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T15:31:59.389 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T15:31:59.401 INFO:teuthology.orchestra.run.smithi038.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 15 15:31 /home/ubuntu/cephtest 2024-04-15T15:31:59.402 INFO:teuthology.orchestra.run.smithi038.stdout: 524598 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 14:57 /home/ubuntu/cephtest/ceph.data 2024-04-15T15:31:59.403 INFO:teuthology.orchestra.run.smithi038.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-15T15:31:59.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T15:31:59.405 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1112, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1181, in cluster raise e File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1163, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi164 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_87dbfb632e974cb2c28d17423071d2d833b53b29/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi038 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-15T15:31:59.406 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-15T15:31:59.421 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-15T15:31:59.432 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-04-15T15:31:59.432 INFO:teuthology.nuke:Checking targets against current locks 2024-04-15T15:31:59.436 INFO:teuthology.orchestra.run.smithi164.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 15 15:31 /home/ubuntu/cephtest 2024-04-15T15:31:59.436 INFO:teuthology.orchestra.run.smithi164.stdout: 655690 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 14:57 /home/ubuntu/cephtest/ceph.data 2024-04-15T15:31:59.437 INFO:teuthology.orchestra.run.smithi164.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-15T15:31:59.462 DEBUG:teuthology.nuke:shortname: smithi038 2024-04-15T15:31:59.462 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T15:31:59.487 DEBUG:teuthology.nuke:shortname: smithi164 2024-04-15T15:31:59.487 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T15:31:59.491 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 14:32:41.700411', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOLjzXDOzgXZQzVqhxbG5Oakkk3pLU1R4C0TuVLccquskFlqweIMfmsWvL47IjkpEc1eUIoV8iPCP89JL9dNZr8='} 2024-04-15T15:31:59.516 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-14_20:00:15-rados-main-distro-default-smithi/7655826', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 14:32:41.698435', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOA2DT3B/BUm0x9GQsawbta3I49Xp2q/1coiuBPx+TZRq/IS+v/NygeXz5+t3MTUkiiiHuDSg4orcWGbJoygu1M='} 2024-04-15T15:31:59.548 INFO:teuthology.orchestra.console.smithi038:Power off 2024-04-15T15:31:59.548 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T15:31:59.574 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2024-04-15T15:31:59.574 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:31:59.593 INFO:teuthology.orchestra.console.smithi164:Power off 2024-04-15T15:31:59.593 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T15:31:59.603 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-15T15:31:59.616 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-04-15T15:31:59.617 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:31:59.644 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-15T15:32:03.604 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:32:03.645 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:32:03.717 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-15T15:32:03.757 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-15T15:32:04.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~15s 2024-04-15T15:32:04.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-15T15:32:07.722 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:32:07.759 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:32:07.833 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-04-15T15:32:07.869 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-15T15:32:07.934 INFO:teuthology.orchestra.console.smithi038:Power off completed 2024-04-15T15:32:09.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~20s 2024-04-15T15:32:09.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~5s 2024-04-15T15:32:11.870 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T15:32:11.986 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-15T15:32:12.087 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-04-15T15:32:12.191 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} duration: 3015.818110704422 failure_reason: 'valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-15T15:32:12.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T15:32:12.280 INFO:teuthology.run:FAIL